ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-0 src: none none 10 [bos] but mike deegan was boiling mad now . [eos] tgt0: mod/noi/dif/loss/nce/logp -67.39 /-0.82 /-66.57 /0.69/-0.69 -7.49 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt1: mod/noi/dif/loss/nce/logp -67.39 /-0.82 /-66.57 / /-0.69 -7.49 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt2: mod/noi/dif/loss/nce/logp -96.17 /-11.74 /-84.43 / /-18.55 -12.02/-1.47 9 [bos] but mike deegan was boiling mad now [eos] tgt3: mod/noi/dif/loss/nce/logp -104.01/-11.95 /-92.07 / /-26.19 -10.40/-1.19 11 [bos] but mike deegan was boiling mad now . . [eos] tgt4: mod/noi/dif/loss/nce/logp -90.85 /-12.28 /-78.57 / /-12.70 -10.09/-1.36 10 [bos] but mike deegan was boiling mad now , [eos] tgt5: mod/noi/dif/loss/nce/logp -188.51/-12.42 /-176.09/ /-110.21 -47.13/-3.10 5 [bos] but mike deegan [eos] cls0 - sp0 : -8.32 -1.66 6 0.00 [bos] ! ! ! was [eos] cls0 - sp1 : -8.64 -1.73 6 0.20 [bos] ! ! ! was [eos] cls0 - sp2 : -8.92 -1.78 6 0.20 [bos] ! ! ! was [eos] cls0 - sp3 : -9.16 -1.83 6 0.20 [bos] ! ! ! was [eos] cls0 - sp4 : -9.28 -1.86 6 0.20 [bos] ! ! ! was [eos] cls1 - sp0 : -8.47 -1.69 6 0.40 [bos] ! ! ! was [eos] cls1 - sp1 : -8.77 -1.75 6 0.40 [bos] ! ! ! was [eos] cls1 - sp2 : -8.93 -1.79 6 0.40 [bos] ! ! ! was [eos] cls1 - sp3 : -9.18 -1.84 6 0.40 [bos] ! ! ! was [eos] cls1 - sp4 : -9.35 -1.87 6 0.40 [bos] ! ! ! was [eos] cls2 - sp0 : -8.23 -1.65 6 0.60 [bos] ! ! ! was [eos] cls2 - sp1 : -8.39 -1.68 6 0.60 [bos] ! ! ! was [eos] cls2 - sp2 : -8.46 -1.69 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -8.71 -1.74 6 0.60 [bos] ! ! ! was [eos] cls2 - sp4 : -9.39 -1.88 6 0.60 [bos] ! ! ! : [eos] cls3 - sp0 : -7.15 -1.43 6 1.00 [bos] ! ! ! : [eos] cls3 - sp1 : -7.80 -1.56 6 0.80 [bos] ! ! ! was [eos] cls3 - sp2 : -8.46 -1.69 6 0.80 [bos] ! ! ! : [eos] cls3 - sp3 : -8.52 -1.70 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -10.05 -2.01 6 0.80 [bos] ! ! ! : [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-1 src: none none 10 [bos] but mike deegan was boiling mad now . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.60 /-0.82 /-70.78 /0.69/-0.69 -7.96 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.60 /-0.82 /-70.78 / /-0.69 -7.96 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt2: mod/noi/dif/loss/nce/logp -100.21/-11.74 /-88.47 / /-18.38 -12.53/-1.47 9 [bos] but mike deegan was boiling mad now [eos] tgt3: mod/noi/dif/loss/nce/logp -108.71/-11.95 /-96.77 / /-26.68 -10.87/-1.19 11 [bos] but mike deegan was boiling mad now . . [eos] tgt4: mod/noi/dif/loss/nce/logp -92.20 /-12.28 /-79.92 / /-9.83 -10.24/-1.36 10 [bos] but mike deegan was boiling mad now , [eos] tgt5: mod/noi/dif/loss/nce/logp -188.53/-12.42 /-176.11/ /-106.02 -47.13/-3.10 5 [bos] but mike deegan [eos] cls0 - sp0 : -8.32 -1.66 6 0.00 [bos] ! ! ! was [eos] cls0 - sp1 : -8.64 -1.73 6 0.20 [bos] ! ! ! was [eos] cls0 - sp2 : -8.92 -1.78 6 0.20 [bos] ! ! ! was [eos] cls0 - sp3 : -9.16 -1.83 6 0.20 [bos] ! ! ! was [eos] cls0 - sp4 : -9.28 -1.86 6 0.20 [bos] ! ! ! was [eos] cls1 - sp0 : -8.47 -1.69 6 0.40 [bos] ! ! ! was [eos] cls1 - sp1 : -8.77 -1.75 6 0.40 [bos] ! ! ! was [eos] cls1 - sp2 : -8.93 -1.79 6 0.40 [bos] ! ! ! was [eos] cls1 - sp3 : -9.18 -1.84 6 0.40 [bos] ! ! ! was [eos] cls1 - sp4 : -9.35 -1.87 6 0.40 [bos] ! ! ! was [eos] cls2 - sp0 : -8.23 -1.65 6 0.60 [bos] ! ! ! was [eos] cls2 - sp1 : -8.39 -1.68 6 0.60 [bos] ! ! ! was [eos] cls2 - sp2 : -8.46 -1.69 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -8.71 -1.74 6 0.60 [bos] ! ! ! was [eos] cls2 - sp4 : -9.39 -1.88 6 0.60 [bos] ! ! ! : [eos] cls3 - sp0 : -7.15 -1.43 6 1.00 [bos] ! ! ! : [eos] cls3 - sp1 : -7.80 -1.56 6 0.80 [bos] ! ! ! was [eos] cls3 - sp2 : -8.46 -1.69 6 0.80 [bos] ! ! ! : [eos] cls3 - sp3 : -8.52 -1.70 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -10.05 -2.01 6 0.80 [bos] ! ! ! : [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-2 src: none none 10 [bos] but mike deegan was boiling mad now . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.09 /-0.82 /-70.27 /0.69/-0.69 -7.90 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.09 /-0.82 /-70.27 / /-0.69 -7.90 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt2: mod/noi/dif/loss/nce/logp -100.93/-11.74 /-89.19 / /-19.61 -12.62/-1.47 9 [bos] but mike deegan was boiling mad now [eos] tgt3: mod/noi/dif/loss/nce/logp -106.85/-11.95 /-94.90 / /-25.33 -10.69/-1.19 11 [bos] but mike deegan was boiling mad now . . [eos] tgt4: mod/noi/dif/loss/nce/logp -95.24 /-12.28 /-82.96 / /-13.38 -10.58/-1.36 10 [bos] but mike deegan was boiling mad now , [eos] tgt5: mod/noi/dif/loss/nce/logp -148.00/-12.42 /-135.58/ /-66.00 -37.00/-3.10 5 [bos] but mike deegan [eos] cls0 - sp0 : -9.05 -1.81 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp1 : -9.28 -1.86 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -9.76 -1.95 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -10.33 -2.07 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -10.59 -2.12 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -9.23 -1.85 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -9.75 -1.95 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -10.56 -2.11 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -10.63 -2.13 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -10.68 -2.14 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -9.38 -1.88 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -9.79 -1.96 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -10.09 -2.02 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -11.95 -1.33 10 0.67 [bos] ! ! ! ! ! ! ! . [eos] cls2 - sp4 : -12.51 -1.39 10 0.56 [bos] ! ! ! ! ! ! ! . [eos] cls3 - sp0 : -9.25 -1.85 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -11.21 -1.25 10 0.89 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp2 : -12.12 -1.35 10 0.78 [bos] ! ! ! ! ! ! ! . [eos] cls3 - sp3 : -12.29 -1.37 10 0.78 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp4 : -12.33 -1.37 10 0.78 [bos] ! ! ! ! ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-3 src: none none 10 [bos] but mike deegan was boiling mad now . [eos] tgt0: mod/noi/dif/loss/nce/logp -75.44 /-0.82 /-74.62 /0.69/-0.69 -8.38 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt1: mod/noi/dif/loss/nce/logp -75.44 /-0.82 /-74.62 / /-0.69 -8.38 /-0.09 10 [bos] but mike deegan was boiling mad now . [eos] tgt2: mod/noi/dif/loss/nce/logp -103.93/-11.74 /-92.19 / /-18.26 -12.99/-1.47 9 [bos] but mike deegan was boiling mad now [eos] tgt3: mod/noi/dif/loss/nce/logp -112.31/-11.95 /-100.36/ /-26.43 -11.23/-1.19 11 [bos] but mike deegan was boiling mad now . . [eos] tgt4: mod/noi/dif/loss/nce/logp -96.29 /-12.28 /-84.00 / /-10.08 -10.70/-1.36 10 [bos] but mike deegan was boiling mad now , [eos] tgt5: mod/noi/dif/loss/nce/logp -143.02/-12.42 /-130.61/ /-56.68 -35.76/-3.10 5 [bos] but mike deegan [eos] cls0 - sp0 : -9.05 -1.81 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp1 : -9.28 -1.86 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -9.76 -1.95 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -10.33 -2.07 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -10.59 -2.12 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -9.23 -1.85 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -9.75 -1.95 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -10.56 -2.11 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -10.63 -2.13 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -10.68 -2.14 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -9.38 -1.88 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -9.79 -1.96 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -10.09 -2.02 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -11.95 -1.33 10 0.67 [bos] ! ! ! ! ! ! ! . [eos] cls2 - sp4 : -12.51 -1.39 10 0.56 [bos] ! ! ! ! ! ! ! . [eos] cls3 - sp0 : -9.25 -1.85 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -11.21 -1.25 10 0.89 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp2 : -12.12 -1.35 10 0.78 [bos] ! ! ! ! ! ! ! . [eos] cls3 - sp3 : -12.29 -1.37 10 0.78 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp4 : -12.33 -1.37 10 0.78 [bos] ! ! ! ! ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-4 src: none none 14 [bos] it began to look as if something was going to happen . [eos] tgt0: mod/noi/dif/loss/nce/logp -52.67 /-1.47 /-51.21 /0.69/-0.69 -4.05 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt1: mod/noi/dif/loss/nce/logp -52.67 /-1.47 /-51.21 / /-0.69 -4.05 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt2: mod/noi/dif/loss/nce/logp -89.51 /-12.35 /-77.15 / /-26.64 -7.46 /-1.03 13 [bos] it began to look as if something was going to happen [eos] tgt3: mod/noi/dif/loss/nce/logp -72.75 /-12.60 /-60.15 / /-9.64 -5.60 /-0.97 14 [bos] the began to look as if something was going to happen . [eos] tgt4: mod/noi/dif/loss/nce/logp -69.27 /-12.11 /-57.16 / /-6.65 -5.33 /-0.93 14 [bos] it began to look as if the was going to happen . [eos] tgt5: mod/noi/dif/loss/nce/logp -87.52 /-12.59 /-74.93 / /-24.42 -6.25 /-0.90 15 [bos] it began to look as if something was going to happen . . [eos] cls0 - sp0 : -22.00 -1.69 14 0.00 [bos] it couldn't to ! as it its was joined to no . [eos] cls0 - sp1 : -22.19 -1.71 14 0.00 [bos] it she to ! as it its was joined to no . [eos] cls0 - sp2 : -22.23 -1.71 14 0.00 [bos] it couldn't to ! as it its was joined to couldn't . [eos] cls0 - sp3 : -22.23 -1.71 14 0.00 [bos] it joined to ! as it its was joined to no . [eos] cls0 - sp4 : -22.25 -1.71 14 0.00 [bos] it streets to ! as it its was joined to no . [eos] cls1 - sp0 : -20.49 -1.58 14 0.46 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp1 : -20.72 -1.59 14 0.46 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp2 : -20.82 -1.60 14 0.38 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp3 : -21.35 -1.64 14 0.38 [bos] ! ! to ! as it ! was ! to ! . [eos] cls1 - sp4 : -21.49 -1.65 14 0.46 [bos] ! ! to ! as it ! was ! to ! . [eos] cls2 - sp0 : -20.22 -1.56 14 0.54 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls2 - sp1 : -20.62 -1.59 14 0.69 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls2 - sp2 : -20.68 -1.59 14 0.62 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls2 - sp3 : -21.19 -1.63 14 0.54 [bos] ! ! to ! as it ! was ! to ! . [eos] cls2 - sp4 : -21.31 -1.64 14 0.62 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls3 - sp0 : -20.12 -1.55 14 0.92 [bos] ! ! to ! as it ! was ! to ! . [eos] cls3 - sp1 : -20.18 -1.55 14 0.85 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls3 - sp2 : -20.87 -1.61 14 1.00 [bos] ! ! to ! as it ! was ! to ! . [eos] cls3 - sp3 : -21.05 -1.62 14 0.92 [bos] it telephone to ! as it ! was ! to ! . [eos] cls3 - sp4 : -21.15 -1.63 14 0.77 [bos] ! ! to ! as ! ! was ! to ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-5 src: none none 14 [bos] it began to look as if something was going to happen . [eos] tgt0: mod/noi/dif/loss/nce/logp -57.35 /-1.47 /-55.88 /0.69/-0.69 -4.41 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt1: mod/noi/dif/loss/nce/logp -57.35 /-1.47 /-55.88 / /-0.69 -4.41 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt2: mod/noi/dif/loss/nce/logp -95.42 /-12.35 /-83.07 / /-27.88 -7.95 /-1.03 13 [bos] it began to look as if something was going to happen [eos] tgt3: mod/noi/dif/loss/nce/logp -78.35 /-12.60 /-65.75 / /-10.57 -6.03 /-0.97 14 [bos] the began to look as if something was going to happen . [eos] tgt4: mod/noi/dif/loss/nce/logp -74.22 /-12.11 /-62.12 / /-6.93 -5.71 /-0.93 14 [bos] it began to look as if the was going to happen . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.99 /-12.59 /-79.39 / /-24.21 -6.57 /-0.90 15 [bos] it began to look as if something was going to happen . . [eos] cls0 - sp0 : -22.00 -1.69 14 0.00 [bos] it couldn't to ! as it its was joined to no . [eos] cls0 - sp1 : -22.19 -1.71 14 0.00 [bos] it she to ! as it its was joined to no . [eos] cls0 - sp2 : -22.23 -1.71 14 0.00 [bos] it couldn't to ! as it its was joined to couldn't . [eos] cls0 - sp3 : -22.23 -1.71 14 0.00 [bos] it joined to ! as it its was joined to no . [eos] cls0 - sp4 : -22.25 -1.71 14 0.00 [bos] it streets to ! as it its was joined to no . [eos] cls1 - sp0 : -20.49 -1.58 14 0.46 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp1 : -20.72 -1.59 14 0.46 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp2 : -20.82 -1.60 14 0.38 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp3 : -21.35 -1.64 14 0.38 [bos] ! ! to ! as it ! was ! to ! . [eos] cls1 - sp4 : -21.49 -1.65 14 0.46 [bos] ! ! to ! as it ! was ! to ! . [eos] cls2 - sp0 : -20.22 -1.56 14 0.54 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls2 - sp1 : -20.62 -1.59 14 0.69 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls2 - sp2 : -20.68 -1.59 14 0.62 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls2 - sp3 : -21.19 -1.63 14 0.54 [bos] ! ! to ! as it ! was ! to ! . [eos] cls2 - sp4 : -21.31 -1.64 14 0.62 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls3 - sp0 : -20.12 -1.55 14 0.92 [bos] ! ! to ! as it ! was ! to ! . [eos] cls3 - sp1 : -20.18 -1.55 14 0.85 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls3 - sp2 : -20.87 -1.61 14 1.00 [bos] ! ! to ! as it ! was ! to ! . [eos] cls3 - sp3 : -21.05 -1.62 14 0.92 [bos] it telephone to ! as it ! was ! to ! . [eos] cls3 - sp4 : -21.15 -1.63 14 0.77 [bos] ! ! to ! as ! ! was ! to ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-6 src: none none 14 [bos] it began to look as if something was going to happen . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.79 /-1.47 /-50.33 /0.69/-0.69 -3.98 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.79 /-1.47 /-50.33 / /-0.69 -3.98 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt2: mod/noi/dif/loss/nce/logp -87.96 /-12.35 /-75.61 / /-25.97 -7.33 /-1.03 13 [bos] it began to look as if something was going to happen [eos] tgt3: mod/noi/dif/loss/nce/logp -72.05 /-12.60 /-59.45 / /-9.81 -5.54 /-0.97 14 [bos] the began to look as if something was going to happen . [eos] tgt4: mod/noi/dif/loss/nce/logp -69.78 /-12.11 /-57.68 / /-8.04 -5.37 /-0.93 14 [bos] it began to look as if the was going to happen . [eos] tgt5: mod/noi/dif/loss/nce/logp -85.39 /-12.59 /-72.80 / /-23.17 -6.10 /-0.90 15 [bos] it began to look as if something was going to happen . . [eos] cls0 - sp0 : -22.18 -1.71 14 0.00 [bos] it couldn't to it as i ! was ! to ! . [eos] cls0 - sp1 : -22.22 -1.71 14 0.00 [bos] it couldn't to it as it ! was ! to ! . [eos] cls0 - sp2 : -22.49 -1.73 14 0.00 [bos] it i to it as i ! was ! to ! . [eos] cls0 - sp3 : -22.99 -1.77 14 0.00 [bos] it couldn't to it as i property was ! to ! . [eos] cls0 - sp4 : -23.12 -1.78 14 0.08 [bos] it couldn't to it as i ! was ! to ! . [eos] cls1 - sp0 : -19.58 -1.51 14 0.46 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp1 : -19.88 -1.53 14 0.38 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp2 : -20.21 -1.55 14 0.38 [bos] ! ! to ! as ! ! she ! to ! . [eos] cls1 - sp3 : -20.33 -1.56 14 0.38 [bos] ! ! to property as ! ! was ! to ! . [eos] cls1 - sp4 : -20.60 -1.58 14 0.31 [bos] ! ! to ! as i ! was ! to ! . [eos] cls2 - sp0 : -17.85 -1.37 14 0.69 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls2 - sp1 : -18.43 -1.42 14 0.62 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls2 - sp2 : -18.48 -1.68 12 0.73 [bos] ! ! to ! as ! ! ! ! to [eos] cls2 - sp3 : -18.81 -1.45 14 0.69 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls2 - sp4 : -18.90 -1.45 14 0.62 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls3 - sp0 : -16.91 -1.30 14 0.92 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls3 - sp1 : -17.91 -1.38 14 0.92 [bos] ! ! to ! as ! ! she ! to ! . [eos] cls3 - sp2 : -17.97 -1.38 14 0.92 [bos] ! ! to property as ! ! ! ! to ! . [eos] cls3 - sp3 : -17.98 -1.38 14 0.85 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls3 - sp4 : -18.06 -1.39 14 0.77 [bos] ! ! to ! as ! ! ! ! to ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-7 src: none none 14 [bos] it began to look as if something was going to happen . [eos] tgt0: mod/noi/dif/loss/nce/logp -57.50 /-1.47 /-56.04 /0.69/-0.69 -4.42 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt1: mod/noi/dif/loss/nce/logp -57.50 /-1.47 /-56.04 / /-0.69 -4.42 /-0.11 14 [bos] it began to look as if something was going to happen . [eos] tgt2: mod/noi/dif/loss/nce/logp -95.30 /-12.35 /-82.95 / /-27.60 -7.94 /-1.03 13 [bos] it began to look as if something was going to happen [eos] tgt3: mod/noi/dif/loss/nce/logp -78.76 /-12.60 /-66.16 / /-10.81 -6.06 /-0.97 14 [bos] the began to look as if something was going to happen . [eos] tgt4: mod/noi/dif/loss/nce/logp -75.94 /-12.11 /-63.84 / /-8.49 -5.84 /-0.93 14 [bos] it began to look as if the was going to happen . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.33 /-12.59 /-78.74 / /-23.40 -6.52 /-0.90 15 [bos] it began to look as if something was going to happen . . [eos] cls0 - sp0 : -22.18 -1.71 14 0.00 [bos] it couldn't to it as i ! was ! to ! . [eos] cls0 - sp1 : -22.22 -1.71 14 0.00 [bos] it couldn't to it as it ! was ! to ! . [eos] cls0 - sp2 : -22.49 -1.73 14 0.00 [bos] it i to it as i ! was ! to ! . [eos] cls0 - sp3 : -22.99 -1.77 14 0.00 [bos] it couldn't to it as i property was ! to ! . [eos] cls0 - sp4 : -23.12 -1.78 14 0.08 [bos] it couldn't to it as i ! was ! to ! . [eos] cls1 - sp0 : -19.58 -1.51 14 0.46 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp1 : -19.88 -1.53 14 0.38 [bos] ! ! to ! as ! ! was ! to ! . [eos] cls1 - sp2 : -20.21 -1.55 14 0.38 [bos] ! ! to ! as ! ! she ! to ! . [eos] cls1 - sp3 : -20.33 -1.56 14 0.38 [bos] ! ! to property as ! ! was ! to ! . [eos] cls1 - sp4 : -20.60 -1.58 14 0.31 [bos] ! ! to ! as i ! was ! to ! . [eos] cls2 - sp0 : -17.85 -1.37 14 0.69 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls2 - sp1 : -18.43 -1.42 14 0.62 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls2 - sp2 : -18.48 -1.68 12 0.73 [bos] ! ! to ! as ! ! ! ! to [eos] cls2 - sp3 : -18.81 -1.45 14 0.69 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls2 - sp4 : -18.90 -1.45 14 0.62 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls3 - sp0 : -16.91 -1.30 14 0.92 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls3 - sp1 : -17.91 -1.38 14 0.92 [bos] ! ! to ! as ! ! she ! to ! . [eos] cls3 - sp2 : -17.97 -1.38 14 0.92 [bos] ! ! to property as ! ! ! ! to ! . [eos] cls3 - sp3 : -17.98 -1.38 14 0.85 [bos] ! ! to ! as ! ! ! ! to ! . [eos] cls3 - sp4 : -18.06 -1.39 14 0.77 [bos] ! ! to ! as ! ! ! ! to ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-8 src: none none 8 [bos] no one said a word . [eos] tgt0: mod/noi/dif/loss/nce/logp -21.15 /-0.83 /-20.32 /2.39/-2.39 -3.02 /-0.12 8 [bos] no one said a word . [eos] tgt1: mod/noi/dif/loss/nce/logp -21.15 /-0.83 /-20.32 / /-2.39 -3.02 /-0.12 8 [bos] no one said a word . [eos] tgt2: mod/noi/dif/loss/nce/logp -53.10 /-11.80 /-41.30 / /-23.37 -8.85 /-1.97 7 [bos] no one said a word [eos] tgt3: mod/noi/dif/loss/nce/logp -45.75 /-11.94 /-33.81 / /-15.88 -6.54 /-1.71 8 [bos] no one said the word . [eos] tgt4: mod/noi/dif/loss/nce/logp -57.69 /-12.01 /-45.68 / /-27.75 -7.21 /-1.50 9 [bos] no one said a word . . [eos] tgt5: mod/noi/dif/loss/nce/logp -29.08 /-10.95 /-18.13 / /-0.20 -4.15 /-1.56 8 [bos] no one `` a word . [eos] cls0 - sp0 : -9.59 -1.37 8 0.14 [bos] ! ! or a ! . [eos] cls0 - sp1 : -9.65 -1.38 8 0.14 [bos] ! ! had a ! . [eos] cls0 - sp2 : -10.05 -1.44 8 0.14 [bos] ! ! only a ! . [eos] cls0 - sp3 : -10.32 -1.47 8 0.14 [bos] ! ? only a ! . [eos] cls0 - sp4 : -10.38 -1.48 8 0.14 [bos] ! ; or a ! . [eos] cls1 - sp0 : -10.28 -1.47 8 0.29 [bos] ! ! only a ! . [eos] cls1 - sp1 : -11.02 -1.57 8 0.29 [bos] ! ! ! a ! ! [eos] cls1 - sp2 : -11.34 -1.62 8 0.29 [bos] ! ! had a ! ! [eos] cls1 - sp3 : -11.65 -1.66 8 0.29 [bos] ! ! or a ! ! [eos] cls1 - sp4 : -11.66 -1.67 8 0.29 [bos] ! ! only a ! ! [eos] cls2 - sp0 : -8.37 -1.20 8 0.71 [bos] ! ; ! a ! ! [eos] cls2 - sp1 : -8.49 -1.21 8 0.71 [bos] ! ! ! a ! ! [eos] cls2 - sp2 : -8.94 -1.28 8 0.71 [bos] ! ! had a ! ! [eos] cls2 - sp3 : -9.28 -1.33 8 0.57 [bos] ! ! ! a ! ! [eos] cls2 - sp4 : -9.35 -1.34 8 0.71 [bos] ! ! only a ! ! [eos] cls3 - sp0 : -8.80 -1.26 8 0.86 [bos] ! ! ! a ! ! [eos] cls3 - sp1 : -9.21 -1.32 8 0.86 [bos] ! ! had a ! ! [eos] cls3 - sp2 : -9.47 -1.35 8 0.86 [bos] ! ! only a ! ! [eos] cls3 - sp3 : -9.71 -1.39 8 0.86 [bos] ! ; ! a ! ! [eos] cls3 - sp4 : -9.88 -1.41 8 0.86 [bos] ! ? had a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-9 src: none none 8 [bos] no one said a word . [eos] tgt0: mod/noi/dif/loss/nce/logp -26.56 /-0.83 /-25.73 /1.42/-1.42 -3.79 /-0.12 8 [bos] no one said a word . [eos] tgt1: mod/noi/dif/loss/nce/logp -26.56 /-0.83 /-25.73 / /-1.42 -3.79 /-0.12 8 [bos] no one said a word . [eos] tgt2: mod/noi/dif/loss/nce/logp -56.21 /-11.80 /-44.42 / /-20.10 -9.37 /-1.97 7 [bos] no one said a word [eos] tgt3: mod/noi/dif/loss/nce/logp -51.15 /-11.94 /-39.21 / /-14.89 -7.31 /-1.71 8 [bos] no one said the word . [eos] tgt4: mod/noi/dif/loss/nce/logp -64.25 /-12.01 /-52.25 / /-27.93 -8.03 /-1.50 9 [bos] no one said a word . . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.92 /-10.95 /-24.98 / /-0.66 -5.13 /-1.56 8 [bos] no one `` a word . [eos] cls0 - sp0 : -9.59 -1.37 8 0.14 [bos] ! ! or a ! . [eos] cls0 - sp1 : -9.65 -1.38 8 0.14 [bos] ! ! had a ! . [eos] cls0 - sp2 : -10.05 -1.44 8 0.14 [bos] ! ! only a ! . [eos] cls0 - sp3 : -10.32 -1.47 8 0.14 [bos] ! ? only a ! . [eos] cls0 - sp4 : -10.38 -1.48 8 0.14 [bos] ! ; or a ! . [eos] cls1 - sp0 : -10.28 -1.47 8 0.29 [bos] ! ! only a ! . [eos] cls1 - sp1 : -11.02 -1.57 8 0.29 [bos] ! ! ! a ! ! [eos] cls1 - sp2 : -11.34 -1.62 8 0.29 [bos] ! ! had a ! ! [eos] cls1 - sp3 : -11.65 -1.66 8 0.29 [bos] ! ! or a ! ! [eos] cls1 - sp4 : -11.66 -1.67 8 0.29 [bos] ! ! only a ! ! [eos] cls2 - sp0 : -8.37 -1.20 8 0.71 [bos] ! ; ! a ! ! [eos] cls2 - sp1 : -8.49 -1.21 8 0.71 [bos] ! ! ! a ! ! [eos] cls2 - sp2 : -8.94 -1.28 8 0.71 [bos] ! ! had a ! ! [eos] cls2 - sp3 : -9.28 -1.33 8 0.57 [bos] ! ! ! a ! ! [eos] cls2 - sp4 : -9.35 -1.34 8 0.71 [bos] ! ! only a ! ! [eos] cls3 - sp0 : -8.80 -1.26 8 0.86 [bos] ! ! ! a ! ! [eos] cls3 - sp1 : -9.21 -1.32 8 0.86 [bos] ! ! had a ! ! [eos] cls3 - sp2 : -9.47 -1.35 8 0.86 [bos] ! ! only a ! ! [eos] cls3 - sp3 : -9.71 -1.39 8 0.86 [bos] ! ; ! a ! ! [eos] cls3 - sp4 : -9.88 -1.41 8 0.86 [bos] ! ? had a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-10 src: none none 8 [bos] no one said a word . [eos] tgt0: mod/noi/dif/loss/nce/logp -20.48 /-0.83 /-19.64 /1.62/-1.62 -2.93 /-0.12 8 [bos] no one said a word . [eos] tgt1: mod/noi/dif/loss/nce/logp -20.48 /-0.83 /-19.64 / /-1.62 -2.93 /-0.12 8 [bos] no one said a word . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.16 /-11.80 /-43.36 / /-25.33 -9.19 /-1.97 7 [bos] no one said a word [eos] tgt3: mod/noi/dif/loss/nce/logp -45.45 /-11.94 /-33.51 / /-15.48 -6.49 /-1.71 8 [bos] no one said the word . [eos] tgt4: mod/noi/dif/loss/nce/logp -55.81 /-12.01 /-43.80 / /-25.77 -6.98 /-1.50 9 [bos] no one said a word . . [eos] tgt5: mod/noi/dif/loss/nce/logp -29.48 /-10.95 /-18.54 / /-0.51 -4.21 /-1.56 8 [bos] no one `` a word . [eos] cls0 - sp0 : -9.43 -1.35 8 0.14 [bos] ! ! or a ! . [eos] cls0 - sp1 : -9.84 -1.41 8 0.14 [bos] ! ! had a ! . [eos] cls0 - sp2 : -10.05 -1.44 8 0.14 [bos] ! ; or a ! . [eos] cls0 - sp3 : -10.26 -1.47 8 0.14 [bos] ! ? or a ! . [eos] cls0 - sp4 : -10.67 -1.52 8 0.00 [bos] ! ! or a ! . [eos] cls1 - sp0 : -10.09 -1.44 8 0.29 [bos] ! ! or a ! . [eos] cls1 - sp1 : -10.37 -1.48 8 0.43 [bos] ! ! had a ! . [eos] cls1 - sp2 : -10.62 -1.52 8 0.29 [bos] ! ; or a ! . [eos] cls1 - sp3 : -10.72 -1.53 8 0.29 [bos] ! ! only a ! . [eos] cls1 - sp4 : -10.72 -1.53 8 0.43 [bos] ! ! ) a ! . [eos] cls2 - sp0 : -9.58 -1.37 8 0.71 [bos] ! ; ! a ! ! [eos] cls2 - sp1 : -9.88 -1.41 8 0.71 [bos] ! ! ! a ! ! [eos] cls2 - sp2 : -10.11 -1.44 8 0.71 [bos] ! ! had a ! ! [eos] cls2 - sp3 : -10.33 -1.48 8 0.57 [bos] ! ! had a ! . [eos] cls2 - sp4 : -10.39 -1.48 8 0.57 [bos] ! ; ! a ! ! [eos] cls3 - sp0 : -10.05 -1.44 8 0.86 [bos] ! ; ! a ! ! [eos] cls3 - sp1 : -10.57 -1.51 8 0.86 [bos] ! ! had a ! ! [eos] cls3 - sp2 : -10.65 -1.52 8 0.86 [bos] ! ! ! a ! ! [eos] cls3 - sp3 : -10.83 -1.55 8 0.86 [bos] ! ! ) a ! ! [eos] cls3 - sp4 : -10.99 -1.57 8 1.00 [bos] ! ! had a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-11 src: none none 8 [bos] no one said a word . [eos] tgt0: mod/noi/dif/loss/nce/logp -27.44 /-0.83 /-26.60 /1.17/-1.17 -3.92 /-0.12 8 [bos] no one said a word . [eos] tgt1: mod/noi/dif/loss/nce/logp -27.44 /-0.83 /-26.60 / /-1.17 -3.92 /-0.12 8 [bos] no one said a word . [eos] tgt2: mod/noi/dif/loss/nce/logp -61.17 /-11.80 /-49.37 / /-23.94 -10.19/-1.97 7 [bos] no one said a word [eos] tgt3: mod/noi/dif/loss/nce/logp -52.15 /-11.94 /-40.21 / /-14.78 -7.45 /-1.71 8 [bos] no one said the word . [eos] tgt4: mod/noi/dif/loss/nce/logp -64.07 /-12.01 /-52.07 / /-26.63 -8.01 /-1.50 9 [bos] no one said a word . . [eos] tgt5: mod/noi/dif/loss/nce/logp -37.35 /-10.95 /-26.40 / /-0.97 -5.34 /-1.56 8 [bos] no one `` a word . [eos] cls0 - sp0 : -9.43 -1.35 8 0.14 [bos] ! ! or a ! . [eos] cls0 - sp1 : -9.84 -1.41 8 0.14 [bos] ! ! had a ! . [eos] cls0 - sp2 : -10.05 -1.44 8 0.14 [bos] ! ; or a ! . [eos] cls0 - sp3 : -10.26 -1.47 8 0.14 [bos] ! ? or a ! . [eos] cls0 - sp4 : -10.67 -1.52 8 0.00 [bos] ! ! or a ! . [eos] cls1 - sp0 : -10.09 -1.44 8 0.29 [bos] ! ! or a ! . [eos] cls1 - sp1 : -10.37 -1.48 8 0.43 [bos] ! ! had a ! . [eos] cls1 - sp2 : -10.62 -1.52 8 0.29 [bos] ! ; or a ! . [eos] cls1 - sp3 : -10.72 -1.53 8 0.29 [bos] ! ! only a ! . [eos] cls1 - sp4 : -10.72 -1.53 8 0.43 [bos] ! ! ) a ! . [eos] cls2 - sp0 : -9.58 -1.37 8 0.71 [bos] ! ; ! a ! ! [eos] cls2 - sp1 : -9.88 -1.41 8 0.71 [bos] ! ! ! a ! ! [eos] cls2 - sp2 : -10.11 -1.44 8 0.71 [bos] ! ! had a ! ! [eos] cls2 - sp3 : -10.33 -1.48 8 0.57 [bos] ! ! had a ! . [eos] cls2 - sp4 : -10.39 -1.48 8 0.57 [bos] ! ; ! a ! ! [eos] cls3 - sp0 : -10.05 -1.44 8 0.86 [bos] ! ; ! a ! ! [eos] cls3 - sp1 : -10.57 -1.51 8 0.86 [bos] ! ! had a ! ! [eos] cls3 - sp2 : -10.65 -1.52 8 0.86 [bos] ! ! ! a ! ! [eos] cls3 - sp3 : -10.83 -1.55 8 0.86 [bos] ! ! ) a ! ! [eos] cls3 - sp4 : -10.99 -1.57 8 1.00 [bos] ! ! had a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-12 src: none none 12 [bos] tell your guys not to block the plate '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -50.32 /-1.12 /-49.20 /0.69/-0.69 -4.57 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -50.32 /-1.12 /-49.20 / /-0.69 -4.57 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -118.36/-22.84 /-95.52 / /-47.02 -10.76/-2.08 12 [bos] tell your guys not to block the plate . . [eos] tgt3: mod/noi/dif/loss/nce/logp -82.61 /-12.02 /-70.58 / /-22.08 -8.26 /-1.20 11 [bos] tell your guys not to block the plate '' [eos] tgt4: mod/noi/dif/loss/nce/logp -86.46 /-12.31 /-74.15 / /-25.64 -7.20 /-1.03 13 [bos] tell your guys not to block the plate '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -156.07/-12.34 /-143.73/ /-95.23 -17.34/-1.37 10 [bos] tell your guys not to block the plate [eos] cls0 - sp0 : -15.41 -1.40 12 0.09 [bos] ! ! ! ! to ! the ! '' . [eos] cls0 - sp1 : -15.71 -1.43 12 0.09 [bos] she ! ! ! to ! the ! '' . [eos] cls0 - sp2 : -15.83 -1.44 12 0.00 [bos] ! ! ! ! to ! the ! '' . [eos] cls0 - sp3 : -15.85 -1.44 12 0.00 [bos] she ! ! ! to ! the ! '' . [eos] cls0 - sp4 : -15.96 -1.45 12 0.18 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp0 : -15.75 -1.43 12 0.36 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp1 : -15.76 -1.43 12 0.27 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp2 : -15.78 -1.43 12 0.45 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp3 : -15.83 -1.44 12 0.45 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp4 : -15.86 -1.44 12 0.36 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp0 : -14.40 -1.31 12 0.73 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp1 : -14.97 -1.36 12 0.64 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp2 : -15.54 -1.41 12 0.55 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp3 : -15.72 -1.43 12 0.55 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp4 : -15.76 -1.43 12 0.64 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp0 : -12.99 -1.18 12 0.91 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp1 : -13.74 -1.25 12 0.82 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp2 : -13.87 -1.26 12 0.91 [bos] ! ! ! ! to later the ! '' . [eos] cls3 - sp3 : -13.96 -1.27 12 0.82 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp4 : -14.14 -1.29 12 0.82 [bos] ! ! ! ! to ! the ! '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-13 src: none none 12 [bos] tell your guys not to block the plate '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -49.64 /-1.12 /-48.51 /0.69/-0.69 -4.51 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -49.64 /-1.12 /-48.51 / /-0.69 -4.51 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -117.64/-22.84 /-94.81 / /-46.99 -10.69/-2.08 12 [bos] tell your guys not to block the plate . . [eos] tgt3: mod/noi/dif/loss/nce/logp -86.26 /-12.02 /-74.23 / /-26.41 -8.63 /-1.20 11 [bos] tell your guys not to block the plate '' [eos] tgt4: mod/noi/dif/loss/nce/logp -87.75 /-12.31 /-75.44 / /-27.62 -7.31 /-1.03 13 [bos] tell your guys not to block the plate '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -146.16/-12.34 /-133.82/ /-86.00 -16.24/-1.37 10 [bos] tell your guys not to block the plate [eos] cls0 - sp0 : -15.41 -1.40 12 0.09 [bos] ! ! ! ! to ! the ! '' . [eos] cls0 - sp1 : -15.71 -1.43 12 0.09 [bos] she ! ! ! to ! the ! '' . [eos] cls0 - sp2 : -15.83 -1.44 12 0.00 [bos] ! ! ! ! to ! the ! '' . [eos] cls0 - sp3 : -15.85 -1.44 12 0.00 [bos] she ! ! ! to ! the ! '' . [eos] cls0 - sp4 : -15.96 -1.45 12 0.18 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp0 : -15.75 -1.43 12 0.36 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp1 : -15.76 -1.43 12 0.27 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp2 : -15.78 -1.43 12 0.45 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp3 : -15.83 -1.44 12 0.45 [bos] ! ! ! ! to ! the ! '' . [eos] cls1 - sp4 : -15.86 -1.44 12 0.36 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp0 : -14.40 -1.31 12 0.73 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp1 : -14.97 -1.36 12 0.64 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp2 : -15.54 -1.41 12 0.55 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp3 : -15.72 -1.43 12 0.55 [bos] ! ! ! ! to ! the ! '' . [eos] cls2 - sp4 : -15.76 -1.43 12 0.64 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp0 : -12.99 -1.18 12 0.91 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp1 : -13.74 -1.25 12 0.82 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp2 : -13.87 -1.26 12 0.91 [bos] ! ! ! ! to later the ! '' . [eos] cls3 - sp3 : -13.96 -1.27 12 0.82 [bos] ! ! ! ! to ! the ! '' . [eos] cls3 - sp4 : -14.14 -1.29 12 0.82 [bos] ! ! ! ! to ! the ! '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-14 src: none none 12 [bos] tell your guys not to block the plate '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.22 /-1.12 /-50.10 /0.69/-0.69 -4.66 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.22 /-1.12 /-50.10 / /-0.69 -4.66 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.79/-22.84 /-90.96 / /-41.55 -10.34/-2.08 12 [bos] tell your guys not to block the plate . . [eos] tgt3: mod/noi/dif/loss/nce/logp -81.14 /-12.02 /-69.12 / /-19.71 -8.11 /-1.20 11 [bos] tell your guys not to block the plate '' [eos] tgt4: mod/noi/dif/loss/nce/logp -86.87 /-12.31 /-74.56 / /-25.15 -7.24 /-1.03 13 [bos] tell your guys not to block the plate '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -130.53/-12.34 /-118.19/ /-68.78 -14.50/-1.37 10 [bos] tell your guys not to block the plate [eos] cls0 - sp0 : -17.30 -1.57 12 0.09 [bos] ! ! couldn't not to she the joined '' . [eos] cls0 - sp1 : -17.36 -1.58 12 0.00 [bos] ! ! couldn't not to she the joined '' . [eos] cls0 - sp2 : -17.41 -1.58 12 0.09 [bos] ! ! couldn't not to she the mean '' . [eos] cls0 - sp3 : -17.42 -1.58 12 0.09 [bos] ! ! couldn't not to she the couldn't '' . [eos] cls0 - sp4 : -17.47 -1.59 12 0.00 [bos] ! ! couldn't not to she the mean '' . [eos] cls1 - sp0 : -16.90 -1.54 12 0.36 [bos] ! ! ! not to she the couldn't '' . [eos] cls1 - sp1 : -17.26 -1.57 12 0.36 [bos] ! ! ! not to she the joined '' . [eos] cls1 - sp2 : -17.34 -1.58 12 0.36 [bos] ! ! ! not to she the mean '' . [eos] cls1 - sp3 : -17.36 -1.58 12 0.36 [bos] ! ! ! not to she the later '' . [eos] cls1 - sp4 : -17.49 -1.59 12 0.36 [bos] ! ! ! not to she the ! '' . [eos] cls2 - sp0 : -17.54 -1.59 12 0.64 [bos] ! ! ! not to she the personal '' . [eos] cls2 - sp1 : -17.64 -1.60 12 0.64 [bos] ! ! ! not to she the later '' . [eos] cls2 - sp2 : -17.68 -1.61 12 0.64 [bos] ! ! ! not to she the don't '' . [eos] cls2 - sp3 : -17.73 -1.61 12 0.64 [bos] ! ! ! not to she the ! '' . [eos] cls2 - sp4 : -17.79 -1.62 12 0.64 [bos] ! ! ! not to she the corner '' . [eos] cls3 - sp0 : -15.38 -1.40 12 0.91 [bos] ! ! ! ! to she the ! '' . [eos] cls3 - sp1 : -15.69 -1.43 12 0.91 [bos] ! ! ! ! to she the personal '' . [eos] cls3 - sp2 : -15.72 -1.43 12 0.91 [bos] ! ! ! ! to she the later '' . [eos] cls3 - sp3 : -15.76 -1.43 12 0.91 [bos] ! ! ! ; to she the ! '' . [eos] cls3 - sp4 : -15.80 -1.44 12 0.91 [bos] ! ! ! ! to she the corner '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-15 src: none none 12 [bos] tell your guys not to block the plate '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.00 /-1.12 /-49.88 /0.69/-0.69 -4.64 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.00 /-1.12 /-49.88 / /-0.69 -4.64 /-0.10 12 [bos] tell your guys not to block the plate '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.38/-22.84 /-90.55 / /-41.36 -10.31/-2.08 12 [bos] tell your guys not to block the plate . . [eos] tgt3: mod/noi/dif/loss/nce/logp -86.10 /-12.02 /-74.07 / /-24.89 -8.61 /-1.20 11 [bos] tell your guys not to block the plate '' [eos] tgt4: mod/noi/dif/loss/nce/logp -88.50 /-12.31 /-76.19 / /-27.01 -7.38 /-1.03 13 [bos] tell your guys not to block the plate '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -125.01/-12.34 /-112.67/ /-63.48 -13.89/-1.37 10 [bos] tell your guys not to block the plate [eos] cls0 - sp0 : -17.30 -1.57 12 0.09 [bos] ! ! couldn't not to she the joined '' . [eos] cls0 - sp1 : -17.36 -1.58 12 0.00 [bos] ! ! couldn't not to she the joined '' . [eos] cls0 - sp2 : -17.41 -1.58 12 0.09 [bos] ! ! couldn't not to she the mean '' . [eos] cls0 - sp3 : -17.42 -1.58 12 0.09 [bos] ! ! couldn't not to she the couldn't '' . [eos] cls0 - sp4 : -17.47 -1.59 12 0.00 [bos] ! ! couldn't not to she the mean '' . [eos] cls1 - sp0 : -16.90 -1.54 12 0.36 [bos] ! ! ! not to she the couldn't '' . [eos] cls1 - sp1 : -17.26 -1.57 12 0.36 [bos] ! ! ! not to she the joined '' . [eos] cls1 - sp2 : -17.34 -1.58 12 0.36 [bos] ! ! ! not to she the mean '' . [eos] cls1 - sp3 : -17.36 -1.58 12 0.36 [bos] ! ! ! not to she the later '' . [eos] cls1 - sp4 : -17.49 -1.59 12 0.36 [bos] ! ! ! not to she the ! '' . [eos] cls2 - sp0 : -17.54 -1.59 12 0.64 [bos] ! ! ! not to she the personal '' . [eos] cls2 - sp1 : -17.64 -1.60 12 0.64 [bos] ! ! ! not to she the later '' . [eos] cls2 - sp2 : -17.68 -1.61 12 0.64 [bos] ! ! ! not to she the don't '' . [eos] cls2 - sp3 : -17.73 -1.61 12 0.64 [bos] ! ! ! not to she the ! '' . [eos] cls2 - sp4 : -17.79 -1.62 12 0.64 [bos] ! ! ! not to she the corner '' . [eos] cls3 - sp0 : -15.38 -1.40 12 0.91 [bos] ! ! ! ! to she the ! '' . [eos] cls3 - sp1 : -15.69 -1.43 12 0.91 [bos] ! ! ! ! to she the personal '' . [eos] cls3 - sp2 : -15.72 -1.43 12 0.91 [bos] ! ! ! ! to she the later '' . [eos] cls3 - sp3 : -15.76 -1.43 12 0.91 [bos] ! ! ! ; to she the ! '' . [eos] cls3 - sp4 : -15.80 -1.44 12 0.91 [bos] ! ! ! ! to she the corner '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-16 src: none none 10 [bos] it was a cold and calculated look . [eos] tgt0: mod/noi/dif/loss/nce/logp -33.37 /-1.02 /-32.35 /0.69/-0.69 -3.71 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt1: mod/noi/dif/loss/nce/logp -33.37 /-1.02 /-32.35 / /-0.69 -3.71 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt2: mod/noi/dif/loss/nce/logp -65.52 /-11.95 /-53.57 / /-21.91 -8.19 /-1.49 9 [bos] it was a cold and calculated look [eos] tgt3: mod/noi/dif/loss/nce/logp -54.74 /-12.21 /-42.53 / /-10.87 -6.08 /-1.36 10 [bos] the was a cold and calculated look . [eos] tgt4: mod/noi/dif/loss/nce/logp -56.69 /-12.09 /-44.61 / /-12.95 -6.30 /-1.34 10 [bos] it was the cold and calculated look . [eos] tgt5: mod/noi/dif/loss/nce/logp -70.00 /-12.17 /-57.83 / /-26.18 -7.00 /-1.22 11 [bos] it was a cold and calculated look . . [eos] cls0 - sp0 : -12.18 -1.35 10 0.00 [bos] it was a later and joined ! . [eos] cls0 - sp1 : -12.52 -1.39 10 0.00 [bos] it was a ! and joined ! . [eos] cls0 - sp2 : -12.55 -1.39 10 0.00 [bos] it was a later and she ! . [eos] cls0 - sp3 : -12.67 -1.41 10 0.00 [bos] it was a ! and she ! . [eos] cls0 - sp4 : -12.80 -1.42 10 0.00 [bos] it was a later and joined when . [eos] cls1 - sp0 : -13.00 -1.44 10 0.33 [bos] ! was a ! and ! ! . [eos] cls1 - sp1 : -13.36 -1.48 10 0.44 [bos] ! was a ! and ! ! . [eos] cls1 - sp2 : -13.51 -1.50 10 0.33 [bos] ! was a ! and ! ! . [eos] cls1 - sp3 : -13.80 -1.53 10 0.33 [bos] ! was a ! and ! ! . [eos] cls1 - sp4 : -13.82 -1.54 10 0.44 [bos] ! was a ! and ! ! . [eos] cls2 - sp0 : -13.63 -1.51 10 0.56 [bos] ! was a ! and ! ! . [eos] cls2 - sp1 : -14.13 -1.57 10 0.56 [bos] ! : a ! and ! ! . [eos] cls2 - sp2 : -14.18 -1.58 10 0.56 [bos] ! was a ! and ! ! . [eos] cls2 - sp3 : -14.68 -1.63 10 0.56 [bos] ! was a ! and ! ! . [eos] cls2 - sp4 : -17.03 -1.89 10 0.67 [bos] ! was a ! and ! ! . [eos] cls3 - sp0 : -13.57 -1.51 10 0.89 [bos] we was a later and corner ! . [eos] cls3 - sp1 : -13.61 -1.51 10 0.89 [bos] we was a later and don't ! . [eos] cls3 - sp2 : -13.62 -1.51 10 1.00 [bos] no was a later and don't ! . [eos] cls3 - sp3 : -13.63 -1.51 10 1.00 [bos] it was a later and don't ! . [eos] cls3 - sp4 : -13.75 -1.53 10 0.89 [bos] we was a later and telephone ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-17 src: none none 10 [bos] it was a cold and calculated look . [eos] tgt0: mod/noi/dif/loss/nce/logp -35.00 /-1.02 /-33.98 /0.69/-0.69 -3.89 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt1: mod/noi/dif/loss/nce/logp -35.00 /-1.02 /-33.98 / /-0.69 -3.89 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt2: mod/noi/dif/loss/nce/logp -71.42 /-11.95 /-59.47 / /-26.18 -8.93 /-1.49 9 [bos] it was a cold and calculated look [eos] tgt3: mod/noi/dif/loss/nce/logp -57.01 /-12.21 /-44.80 / /-11.51 -6.33 /-1.36 10 [bos] the was a cold and calculated look . [eos] tgt4: mod/noi/dif/loss/nce/logp -59.15 /-12.09 /-47.06 / /-13.77 -6.57 /-1.34 10 [bos] it was the cold and calculated look . [eos] tgt5: mod/noi/dif/loss/nce/logp -71.52 /-12.17 /-59.35 / /-26.07 -7.15 /-1.22 11 [bos] it was a cold and calculated look . . [eos] cls0 - sp0 : -12.18 -1.35 10 0.00 [bos] it was a later and joined ! . [eos] cls0 - sp1 : -12.52 -1.39 10 0.00 [bos] it was a ! and joined ! . [eos] cls0 - sp2 : -12.55 -1.39 10 0.00 [bos] it was a later and she ! . [eos] cls0 - sp3 : -12.67 -1.41 10 0.00 [bos] it was a ! and she ! . [eos] cls0 - sp4 : -12.80 -1.42 10 0.00 [bos] it was a later and joined when . [eos] cls1 - sp0 : -13.00 -1.44 10 0.33 [bos] ! was a ! and ! ! . [eos] cls1 - sp1 : -13.36 -1.48 10 0.44 [bos] ! was a ! and ! ! . [eos] cls1 - sp2 : -13.51 -1.50 10 0.33 [bos] ! was a ! and ! ! . [eos] cls1 - sp3 : -13.80 -1.53 10 0.33 [bos] ! was a ! and ! ! . [eos] cls1 - sp4 : -13.82 -1.54 10 0.44 [bos] ! was a ! and ! ! . [eos] cls2 - sp0 : -13.63 -1.51 10 0.56 [bos] ! was a ! and ! ! . [eos] cls2 - sp1 : -14.13 -1.57 10 0.56 [bos] ! : a ! and ! ! . [eos] cls2 - sp2 : -14.18 -1.58 10 0.56 [bos] ! was a ! and ! ! . [eos] cls2 - sp3 : -14.68 -1.63 10 0.56 [bos] ! was a ! and ! ! . [eos] cls2 - sp4 : -17.03 -1.89 10 0.67 [bos] ! was a ! and ! ! . [eos] cls3 - sp0 : -13.57 -1.51 10 0.89 [bos] we was a later and corner ! . [eos] cls3 - sp1 : -13.61 -1.51 10 0.89 [bos] we was a later and don't ! . [eos] cls3 - sp2 : -13.62 -1.51 10 1.00 [bos] no was a later and don't ! . [eos] cls3 - sp3 : -13.63 -1.51 10 1.00 [bos] it was a later and don't ! . [eos] cls3 - sp4 : -13.75 -1.53 10 0.89 [bos] we was a later and telephone ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-18 src: none none 10 [bos] it was a cold and calculated look . [eos] tgt0: mod/noi/dif/loss/nce/logp -33.54 /-1.02 /-32.52 /0.69/-0.69 -3.73 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt1: mod/noi/dif/loss/nce/logp -33.54 /-1.02 /-32.52 / /-0.69 -3.73 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt2: mod/noi/dif/loss/nce/logp -65.39 /-11.95 /-53.44 / /-21.61 -8.17 /-1.49 9 [bos] it was a cold and calculated look [eos] tgt3: mod/noi/dif/loss/nce/logp -55.06 /-12.21 /-42.84 / /-11.02 -6.12 /-1.36 10 [bos] the was a cold and calculated look . [eos] tgt4: mod/noi/dif/loss/nce/logp -57.94 /-12.09 /-45.86 / /-14.03 -6.44 /-1.34 10 [bos] it was the cold and calculated look . [eos] tgt5: mod/noi/dif/loss/nce/logp -69.42 /-12.17 /-57.25 / /-25.42 -6.94 /-1.22 11 [bos] it was a cold and calculated look . . [eos] cls0 - sp0 : -13.31 -1.48 10 0.00 [bos] it was a no and joined it . [eos] cls0 - sp1 : -13.37 -1.49 10 0.00 [bos] it was a later and joined it . [eos] cls0 - sp2 : -13.70 -1.52 10 0.00 [bos] it was a no and couldn't it . [eos] cls0 - sp3 : -13.76 -1.53 10 0.00 [bos] it was a later and couldn't it . [eos] cls0 - sp4 : -13.78 -1.53 10 0.00 [bos] it was a any and joined it . [eos] cls1 - sp0 : -17.46 -1.94 10 0.33 [bos] it was a ! and ! ! . [eos] cls1 - sp1 : -17.48 -1.94 10 0.33 [bos] ! she a ! and ! ! . [eos] cls1 - sp2 : -17.56 -1.95 10 0.33 [bos] it was a ! and 7 it . [eos] cls1 - sp3 : -17.79 -1.98 10 0.44 [bos] it was a ! and 7 ! . [eos] cls1 - sp4 : -21.92 -2.44 10 0.33 [bos] it was a ! and ! ! . [eos] cls2 - sp0 : -18.04 -2.00 10 0.56 [bos] it was a later and telephone property . [eos] cls2 - sp1 : -18.05 -2.01 10 0.56 [bos] it was a later and 7 property . [eos] cls2 - sp2 : -18.09 -2.01 10 0.56 [bos] it was a ! and 7 ! . [eos] cls2 - sp3 : -18.18 -2.02 10 0.56 [bos] it was a no and 7 property . [eos] cls2 - sp4 : -18.19 -2.02 10 0.56 [bos] it was a later and don't property . [eos] cls3 - sp0 : -14.28 -1.59 10 0.89 [bos] we was a later and corner property . [eos] cls3 - sp1 : -14.33 -1.59 10 0.89 [bos] we was a later and telephone property . [eos] cls3 - sp2 : -14.45 -1.61 10 0.89 [bos] ! she a later and telephone property . [eos] cls3 - sp3 : -14.55 -1.62 10 0.89 [bos] we was a later and telephone did . [eos] cls3 - sp4 : -14.56 -1.62 10 0.89 [bos] ! she a later and corner property . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-19 src: none none 10 [bos] it was a cold and calculated look . [eos] tgt0: mod/noi/dif/loss/nce/logp -36.80 /-1.02 /-35.78 /0.69/-0.69 -4.09 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt1: mod/noi/dif/loss/nce/logp -36.80 /-1.02 /-35.78 / /-0.69 -4.09 /-0.11 10 [bos] it was a cold and calculated look . [eos] tgt2: mod/noi/dif/loss/nce/logp -73.71 /-11.95 /-61.76 / /-26.67 -9.21 /-1.49 9 [bos] it was a cold and calculated look [eos] tgt3: mod/noi/dif/loss/nce/logp -59.17 /-12.21 /-46.96 / /-11.87 -6.57 /-1.36 10 [bos] the was a cold and calculated look . [eos] tgt4: mod/noi/dif/loss/nce/logp -62.05 /-12.09 /-49.96 / /-14.87 -6.89 /-1.34 10 [bos] it was the cold and calculated look . [eos] tgt5: mod/noi/dif/loss/nce/logp -73.54 /-12.17 /-61.37 / /-26.28 -7.35 /-1.22 11 [bos] it was a cold and calculated look . . [eos] cls0 - sp0 : -13.31 -1.48 10 0.00 [bos] it was a no and joined it . [eos] cls0 - sp1 : -13.37 -1.49 10 0.00 [bos] it was a later and joined it . [eos] cls0 - sp2 : -13.70 -1.52 10 0.00 [bos] it was a no and couldn't it . [eos] cls0 - sp3 : -13.76 -1.53 10 0.00 [bos] it was a later and couldn't it . [eos] cls0 - sp4 : -13.78 -1.53 10 0.00 [bos] it was a any and joined it . [eos] cls1 - sp0 : -17.46 -1.94 10 0.33 [bos] it was a ! and ! ! . [eos] cls1 - sp1 : -17.48 -1.94 10 0.33 [bos] ! she a ! and ! ! . [eos] cls1 - sp2 : -17.56 -1.95 10 0.33 [bos] it was a ! and 7 it . [eos] cls1 - sp3 : -17.79 -1.98 10 0.44 [bos] it was a ! and 7 ! . [eos] cls1 - sp4 : -21.92 -2.44 10 0.33 [bos] it was a ! and ! ! . [eos] cls2 - sp0 : -18.04 -2.00 10 0.56 [bos] it was a later and telephone property . [eos] cls2 - sp1 : -18.05 -2.01 10 0.56 [bos] it was a later and 7 property . [eos] cls2 - sp2 : -18.09 -2.01 10 0.56 [bos] it was a ! and 7 ! . [eos] cls2 - sp3 : -18.18 -2.02 10 0.56 [bos] it was a no and 7 property . [eos] cls2 - sp4 : -18.19 -2.02 10 0.56 [bos] it was a later and don't property . [eos] cls3 - sp0 : -14.28 -1.59 10 0.89 [bos] we was a later and corner property . [eos] cls3 - sp1 : -14.33 -1.59 10 0.89 [bos] we was a later and telephone property . [eos] cls3 - sp2 : -14.45 -1.61 10 0.89 [bos] ! she a later and telephone property . [eos] cls3 - sp3 : -14.55 -1.62 10 0.89 [bos] we was a later and telephone did . [eos] cls3 - sp4 : -14.56 -1.62 10 0.89 [bos] ! she a later and corner property . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-20 src: none none 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.40 /-1.93 /-70.47 /0.69/-0.69 -4.26 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.40 /-1.93 /-70.47 / /-0.69 -4.26 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.97/-12.81 /-101.16/ /-31.38 -7.12 /-0.80 17 [bos] he stood [unk] in the box , but not very close to the plate now [eos] tgt3: mod/noi/dif/loss/nce/logp -224.42/-12.39 /-212.03/ /-142.25 -28.05/-1.55 9 [bos] he stood [unk] in the box . [eos] tgt4: mod/noi/dif/loss/nce/logp -108.81/-13.05 /-95.76 / /-25.98 -6.05 /-0.73 19 [bos] he stood [unk] in the box , but not very close to the plate now . . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.01 /-12.51 /-78.50 / /-8.72 -5.35 /-0.74 18 [bos] he stood [unk] in the box , but , very close to the plate now . [eos] cls0 - sp0 : -15.74 -1.43 12 0.00 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp1 : -15.75 -1.43 12 0.09 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp2 : -19.93 -1.81 12 0.18 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp3 : -20.56 -1.87 12 0.09 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp4 : -26.90 -1.58 18 0.00 [bos] we property [unk] in the streets , but not she ! to the ! ! . [eos] cls1 - sp0 : -18.63 -1.69 12 0.36 [bos] ! ! [unk] in the streets , ! ! ! [eos] cls1 - sp1 : -18.68 -1.70 12 0.36 [bos] ! ! [unk] in the streets , ! ! ! [eos] cls1 - sp2 : -18.86 -1.71 12 0.45 [bos] ! ! [unk] in the streets , ! ! ! [eos] cls1 - sp3 : -18.94 -1.72 12 0.36 [bos] ! ! [unk] in the editor , ! ! ! [eos] cls1 - sp4 : -19.01 -1.73 12 0.36 [bos] ! ! [unk] in the editor , ! ! ! [eos] cls2 - sp0 : -16.91 -1.54 12 0.73 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls2 - sp1 : -16.98 -1.54 12 0.64 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls2 - sp2 : -17.16 -1.56 12 0.73 [bos] ! ! [unk] in the don't , ! ! ! [eos] cls2 - sp3 : -17.21 -1.56 12 0.64 [bos] ! ! [unk] in the don't , ! ! ! [eos] cls2 - sp4 : -17.43 -1.58 12 0.73 [bos] ! ! [unk] in the 7 , ! ! ! [eos] cls3 - sp0 : -13.98 -1.27 12 1.00 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls3 - sp1 : -14.23 -1.29 12 1.00 [bos] ! ! [unk] in the corner , ! ! ! [eos] cls3 - sp2 : -14.73 -1.34 12 0.91 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls3 - sp3 : -14.96 -1.36 12 1.00 [bos] ! ! [unk] in the telephone , but ! ! [eos] cls3 - sp4 : -15.07 -1.37 12 0.91 [bos] ! ! [unk] in the corner , ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-21 src: none none 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.47 /-1.93 /-70.54 /0.69/-0.69 -4.26 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.47 /-1.93 /-70.54 / /-0.69 -4.26 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt2: mod/noi/dif/loss/nce/logp -114.35/-12.81 /-101.54/ /-31.69 -7.15 /-0.80 17 [bos] he stood [unk] in the box , but not very close to the plate now [eos] tgt3: mod/noi/dif/loss/nce/logp -214.92/-12.39 /-202.53/ /-132.68 -26.86/-1.55 9 [bos] he stood [unk] in the box . [eos] tgt4: mod/noi/dif/loss/nce/logp -110.12/-13.05 /-97.07 / /-27.22 -6.12 /-0.73 19 [bos] he stood [unk] in the box , but not very close to the plate now . . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.35 /-12.51 /-78.83 / /-8.99 -5.37 /-0.74 18 [bos] he stood [unk] in the box , but , very close to the plate now . [eos] cls0 - sp0 : -15.74 -1.43 12 0.00 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp1 : -15.75 -1.43 12 0.09 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp2 : -19.93 -1.81 12 0.18 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp3 : -20.56 -1.87 12 0.09 [bos] we property [unk] in the streets , ! ! ! [eos] cls0 - sp4 : -26.90 -1.58 18 0.00 [bos] we property [unk] in the streets , but not she ! to the ! ! . [eos] cls1 - sp0 : -18.63 -1.69 12 0.36 [bos] ! ! [unk] in the streets , ! ! ! [eos] cls1 - sp1 : -18.68 -1.70 12 0.36 [bos] ! ! [unk] in the streets , ! ! ! [eos] cls1 - sp2 : -18.86 -1.71 12 0.45 [bos] ! ! [unk] in the streets , ! ! ! [eos] cls1 - sp3 : -18.94 -1.72 12 0.36 [bos] ! ! [unk] in the editor , ! ! ! [eos] cls1 - sp4 : -19.01 -1.73 12 0.36 [bos] ! ! [unk] in the editor , ! ! ! [eos] cls2 - sp0 : -16.91 -1.54 12 0.73 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls2 - sp1 : -16.98 -1.54 12 0.64 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls2 - sp2 : -17.16 -1.56 12 0.73 [bos] ! ! [unk] in the don't , ! ! ! [eos] cls2 - sp3 : -17.21 -1.56 12 0.64 [bos] ! ! [unk] in the don't , ! ! ! [eos] cls2 - sp4 : -17.43 -1.58 12 0.73 [bos] ! ! [unk] in the 7 , ! ! ! [eos] cls3 - sp0 : -13.98 -1.27 12 1.00 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls3 - sp1 : -14.23 -1.29 12 1.00 [bos] ! ! [unk] in the corner , ! ! ! [eos] cls3 - sp2 : -14.73 -1.34 12 0.91 [bos] ! ! [unk] in the telephone , ! ! ! [eos] cls3 - sp3 : -14.96 -1.36 12 1.00 [bos] ! ! [unk] in the telephone , but ! ! [eos] cls3 - sp4 : -15.07 -1.37 12 0.91 [bos] ! ! [unk] in the corner , ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-22 src: none none 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.77 /-1.93 /-70.84 /0.69/-0.69 -4.28 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.77 /-1.93 /-70.84 / /-0.69 -4.28 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt2: mod/noi/dif/loss/nce/logp -114.42/-12.81 /-101.61/ /-31.47 -7.15 /-0.80 17 [bos] he stood [unk] in the box , but not very close to the plate now [eos] tgt3: mod/noi/dif/loss/nce/logp -200.32/-12.39 /-187.93/ /-117.79 -25.04/-1.55 9 [bos] he stood [unk] in the box . [eos] tgt4: mod/noi/dif/loss/nce/logp -106.65/-13.05 /-93.60 / /-23.46 -5.93 /-0.73 19 [bos] he stood [unk] in the box , but not very close to the plate now . . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.89 /-12.51 /-79.38 / /-9.24 -5.41 /-0.74 18 [bos] he stood [unk] in the box , but , very close to the plate now . [eos] cls0 - sp0 : -27.96 -1.64 18 0.00 [bos] i all [unk] in the streets , but not all joined to the joined ! . [eos] cls0 - sp1 : -28.00 -1.65 18 0.00 [bos] i all [unk] in the joined , but not all joined to the joined ! . [eos] cls0 - sp2 : -28.15 -1.66 18 0.00 [bos] i all [unk] in the streets , but not all joined to the couldn't ! . [eos] cls0 - sp3 : -28.20 -1.66 18 0.00 [bos] i all [unk] in the joined , but not all joined to the couldn't ! . [eos] cls0 - sp4 : -28.28 -1.66 18 0.00 [bos] i all [unk] in the streets , but not all couldn't to the couldn't ! . [eos] cls1 - sp0 : -21.24 -1.93 12 0.36 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp1 : -21.50 -1.95 12 0.27 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp2 : -22.57 -2.05 12 0.45 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp3 : -23.70 -2.15 12 0.36 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp4 : -24.02 -2.18 12 0.36 [bos] i we [unk] in the streets , but ! ! [eos] cls2 - sp0 : -25.07 -2.28 12 0.64 [bos] when we [unk] in the telephone , ! not ! [eos] cls2 - sp1 : -25.43 -2.31 12 0.73 [bos] when we [unk] in the telephone , ! not ! [eos] cls2 - sp2 : -25.63 -2.33 12 0.64 [bos] when we [unk] in the don't , ! not ! [eos] cls2 - sp3 : -33.24 -1.96 18 0.71 [bos] when we [unk] in the telephone , ! not ! ! to the don't ! . [eos] cls2 - sp4 : -33.33 -1.96 18 0.71 [bos] when we [unk] in the telephone , ! not ! ! to the ! ! . [eos] cls3 - sp0 : -26.66 -1.57 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the corner ! . [eos] cls3 - sp1 : -26.79 -1.58 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the don't ! . [eos] cls3 - sp2 : -27.00 -1.59 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the telephone ! . [eos] cls3 - sp3 : -27.06 -1.59 18 1.00 [bos] we made [unk] in the telephone , but not all personal to the corner ! . [eos] cls3 - sp4 : -27.09 -1.59 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the later ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-23 src: none none 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt0: mod/noi/dif/loss/nce/logp -73.37 /-1.93 /-71.44 /0.69/-0.69 -4.32 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt1: mod/noi/dif/loss/nce/logp -73.37 /-1.93 /-71.44 / /-0.69 -4.32 /-0.11 18 [bos] he stood [unk] in the box , but not very close to the plate now . [eos] tgt2: mod/noi/dif/loss/nce/logp -115.84/-12.81 /-103.03/ /-32.29 -7.24 /-0.80 17 [bos] he stood [unk] in the box , but not very close to the plate now [eos] tgt3: mod/noi/dif/loss/nce/logp -200.22/-12.39 /-187.84/ /-117.09 -25.03/-1.55 9 [bos] he stood [unk] in the box . [eos] tgt4: mod/noi/dif/loss/nce/logp -109.63/-13.05 /-96.58 / /-25.83 -6.09 /-0.73 19 [bos] he stood [unk] in the box , but not very close to the plate now . . [eos] tgt5: mod/noi/dif/loss/nce/logp -92.67 /-12.51 /-80.16 / /-9.42 -5.45 /-0.74 18 [bos] he stood [unk] in the box , but , very close to the plate now . [eos] cls0 - sp0 : -27.96 -1.64 18 0.00 [bos] i all [unk] in the streets , but not all joined to the joined ! . [eos] cls0 - sp1 : -28.00 -1.65 18 0.00 [bos] i all [unk] in the joined , but not all joined to the joined ! . [eos] cls0 - sp2 : -28.15 -1.66 18 0.00 [bos] i all [unk] in the streets , but not all joined to the couldn't ! . [eos] cls0 - sp3 : -28.20 -1.66 18 0.00 [bos] i all [unk] in the joined , but not all joined to the couldn't ! . [eos] cls0 - sp4 : -28.28 -1.66 18 0.00 [bos] i all [unk] in the streets , but not all couldn't to the couldn't ! . [eos] cls1 - sp0 : -21.24 -1.93 12 0.36 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp1 : -21.50 -1.95 12 0.27 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp2 : -22.57 -2.05 12 0.45 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp3 : -23.70 -2.15 12 0.36 [bos] i we [unk] in the editor , ! ! ! [eos] cls1 - sp4 : -24.02 -2.18 12 0.36 [bos] i we [unk] in the streets , but ! ! [eos] cls2 - sp0 : -25.07 -2.28 12 0.64 [bos] when we [unk] in the telephone , ! not ! [eos] cls2 - sp1 : -25.43 -2.31 12 0.73 [bos] when we [unk] in the telephone , ! not ! [eos] cls2 - sp2 : -25.63 -2.33 12 0.64 [bos] when we [unk] in the don't , ! not ! [eos] cls2 - sp3 : -33.24 -1.96 18 0.71 [bos] when we [unk] in the telephone , ! not ! ! to the don't ! . [eos] cls2 - sp4 : -33.33 -1.96 18 0.71 [bos] when we [unk] in the telephone , ! not ! ! to the ! ! . [eos] cls3 - sp0 : -26.66 -1.57 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the corner ! . [eos] cls3 - sp1 : -26.79 -1.58 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the don't ! . [eos] cls3 - sp2 : -27.00 -1.59 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the telephone ! . [eos] cls3 - sp3 : -27.06 -1.59 18 1.00 [bos] we made [unk] in the telephone , but not all personal to the corner ! . [eos] cls3 - sp4 : -27.09 -1.59 18 1.00 [bos] she made [unk] in the telephone , but not all personal to the later ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-24 src: none none 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.01 /-1.01 /-71.00 /9.93/-9.93 -6.55 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.01 /-1.01 /-71.00 / /-9.93 -6.55 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt2: mod/noi/dif/loss/nce/logp -107.46/-11.98 /-95.48 / /-34.41 -10.75/-1.20 11 [bos] riverside and anniston players rushed out on the field [eos] tgt3: mod/noi/dif/loss/nce/logp -108.69/-12.17 /-96.52 / /-35.46 -9.06 /-1.01 13 [bos] riverside and anniston players rushed out on the field . . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.32 /-12.20 /-61.12 / /-0.06 -6.67 /-1.11 12 [bos] riverside and anniston players rushed out on the vital . [eos] tgt5: mod/noi/dif/loss/nce/logp -76.68 /-12.69 /-63.99 / /-2.93 -6.97 /-1.15 12 [bos] tantalizing and anniston players rushed out on the field . [eos] cls0 - sp0 : -7.73 -1.93 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -13.52 -2.70 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -14.19 -2.84 6 0.20 [bos] ! -- she ! [eos] cls0 - sp3 : -14.36 -2.87 6 0.20 [bos] ! -- ! ! [eos] cls0 - sp4 : -14.49 -2.90 6 0.20 [bos] ! -- couldn't ! [eos] cls1 - sp0 : -7.00 -1.75 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -8.78 -2.19 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -9.08 -2.27 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -9.77 -2.44 5 0.25 [bos] ! ; ! [eos] cls1 - sp4 : -10.07 -2.52 5 0.25 [bos] ! ! ! [eos] cls2 - sp0 : -7.79 -1.95 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -8.30 -2.08 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -8.39 -2.10 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -9.59 -2.40 5 0.50 [bos] ! -- ! [eos] cls2 - sp4 : -9.59 -2.40 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -7.17 -1.79 5 1.00 [bos] ! ! ! [eos] cls3 - sp1 : -7.79 -1.95 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -7.93 -1.98 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -8.55 -2.14 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -9.21 -2.30 5 0.75 [bos] ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-25 src: none none 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt0: mod/noi/dif/loss/nce/logp -75.59 /-1.01 /-74.58 /9.59/-9.59 -6.87 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt1: mod/noi/dif/loss/nce/logp -75.59 /-1.01 /-74.58 / /-9.59 -6.87 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt2: mod/noi/dif/loss/nce/logp -112.90/-11.98 /-100.92/ /-35.93 -11.29/-1.20 11 [bos] riverside and anniston players rushed out on the field [eos] tgt3: mod/noi/dif/loss/nce/logp -113.92/-12.17 /-101.75/ /-36.76 -9.49 /-1.01 13 [bos] riverside and anniston players rushed out on the field . . [eos] tgt4: mod/noi/dif/loss/nce/logp -77.26 /-12.20 /-65.06 / /-0.07 -7.02 /-1.11 12 [bos] riverside and anniston players rushed out on the vital . [eos] tgt5: mod/noi/dif/loss/nce/logp -80.37 /-12.69 /-67.69 / /-2.70 -7.31 /-1.15 12 [bos] tantalizing and anniston players rushed out on the field . [eos] cls0 - sp0 : -7.73 -1.93 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -13.52 -2.70 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -14.19 -2.84 6 0.20 [bos] ! -- she ! [eos] cls0 - sp3 : -14.36 -2.87 6 0.20 [bos] ! -- ! ! [eos] cls0 - sp4 : -14.49 -2.90 6 0.20 [bos] ! -- couldn't ! [eos] cls1 - sp0 : -7.00 -1.75 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -8.78 -2.19 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -9.08 -2.27 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -9.77 -2.44 5 0.25 [bos] ! ; ! [eos] cls1 - sp4 : -10.07 -2.52 5 0.25 [bos] ! ! ! [eos] cls2 - sp0 : -7.79 -1.95 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -8.30 -2.08 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -8.39 -2.10 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -9.59 -2.40 5 0.50 [bos] ! -- ! [eos] cls2 - sp4 : -9.59 -2.40 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -7.17 -1.79 5 1.00 [bos] ! ! ! [eos] cls3 - sp1 : -7.79 -1.95 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -7.93 -1.98 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -8.55 -2.14 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -9.21 -2.30 5 0.75 [bos] ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-26 src: none none 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.96 /-1.01 /-70.95 /9.61/-9.61 -6.54 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.96 /-1.01 /-70.95 / /-9.61 -6.54 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt2: mod/noi/dif/loss/nce/logp -104.94/-11.98 /-92.96 / /-31.63 -10.49/-1.20 11 [bos] riverside and anniston players rushed out on the field [eos] tgt3: mod/noi/dif/loss/nce/logp -108.17/-12.17 /-96.00 / /-34.66 -9.01 /-1.01 13 [bos] riverside and anniston players rushed out on the field . . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.63 /-12.20 /-61.43 / /-0.09 -6.69 /-1.11 12 [bos] riverside and anniston players rushed out on the vital . [eos] tgt5: mod/noi/dif/loss/nce/logp -76.49 /-12.69 /-63.81 / /-2.47 -6.95 /-1.15 12 [bos] tantalizing and anniston players rushed out on the field . [eos] cls0 - sp0 : -10.76 -2.15 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.20 -2.24 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -11.52 -2.30 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp3 : -12.21 -2.44 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -12.95 -2.59 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -10.30 -2.06 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -10.99 -2.20 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.56 -2.31 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -12.10 -2.42 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -12.31 -2.46 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -10.14 -2.03 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -11.05 -2.21 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.38 -2.28 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -11.45 -2.29 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -11.70 -2.34 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -9.73 -1.95 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -10.03 -2.01 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -10.77 -2.15 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -11.08 -2.22 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -11.23 -2.25 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-27 src: none none 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt0: mod/noi/dif/loss/nce/logp -78.14 /-1.01 /-77.13 /9.88/-9.88 -7.10 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt1: mod/noi/dif/loss/nce/logp -78.14 /-1.01 /-77.13 / /-9.88 -7.10 /-0.09 12 [bos] riverside and anniston players rushed out on the field . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.95/-11.98 /-101.97/ /-34.72 -11.39/-1.20 11 [bos] riverside and anniston players rushed out on the field [eos] tgt3: mod/noi/dif/loss/nce/logp -116.03/-12.17 /-103.86/ /-36.61 -9.67 /-1.01 13 [bos] riverside and anniston players rushed out on the field . . [eos] tgt4: mod/noi/dif/loss/nce/logp -79.54 /-12.20 /-67.33 / /-0.09 -7.23 /-1.11 12 [bos] riverside and anniston players rushed out on the vital . [eos] tgt5: mod/noi/dif/loss/nce/logp -82.44 /-12.69 /-69.75 / /-2.50 -7.49 /-1.15 12 [bos] tantalizing and anniston players rushed out on the field . [eos] cls0 - sp0 : -10.76 -2.15 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.20 -2.24 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -11.52 -2.30 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp3 : -12.21 -2.44 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -12.95 -2.59 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -10.30 -2.06 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -10.99 -2.20 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.56 -2.31 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -12.10 -2.42 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -12.31 -2.46 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -10.14 -2.03 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -11.05 -2.21 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.38 -2.28 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -11.45 -2.29 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -11.70 -2.34 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -9.73 -1.95 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -10.03 -2.01 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -10.77 -2.15 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -11.08 -2.22 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -11.23 -2.25 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-28 src: none none 10 [bos] `` now listen to me , phil . [eos] tgt0: mod/noi/dif/loss/nce/logp -42.65 /-0.99 /-41.66 /0.69/-0.69 -4.74 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt1: mod/noi/dif/loss/nce/logp -42.65 /-0.99 /-41.66 / /-0.69 -4.74 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt2: mod/noi/dif/loss/nce/logp -76.89 /-11.91 /-64.98 / /-24.01 -9.61 /-1.49 9 [bos] `` now listen to me , phil [eos] tgt3: mod/noi/dif/loss/nce/logp -62.81 /-11.33 /-51.48 / /-10.51 -6.98 /-1.26 10 [bos] `` now listen to , , phil . [eos] tgt4: mod/noi/dif/loss/nce/logp -79.44 /-12.17 /-67.27 / /-26.30 -7.94 /-1.22 11 [bos] `` now listen to me , phil . . [eos] tgt5: mod/noi/dif/loss/nce/logp -64.26 /-11.88 /-52.38 / /-11.41 -7.14 /-1.32 10 [bos] a now listen to me , phil . [eos] cls0 - sp0 : -14.33 -1.59 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp1 : -14.54 -1.62 10 0.11 [bos] ! ! ! to ! , ! . [eos] cls0 - sp2 : -14.84 -1.65 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp3 : -14.96 -1.66 10 0.11 [bos] ! ! ! to ! , ! . [eos] cls0 - sp4 : -14.98 -1.66 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls1 - sp0 : -13.88 -1.54 10 0.44 [bos] ! ! ! to ! , ! . [eos] cls1 - sp1 : -14.18 -1.58 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp2 : -14.28 -1.59 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp3 : -14.36 -1.60 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp4 : -14.83 -1.65 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls2 - sp0 : -13.46 -1.50 10 0.67 [bos] ! ! ! to ! , ! . [eos] cls2 - sp1 : -13.64 -1.52 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp2 : -13.73 -1.53 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp3 : -13.98 -1.55 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp4 : -14.06 -1.56 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls3 - sp0 : -12.42 -1.38 10 1.00 [bos] ! ! ! to ! , ! . [eos] cls3 - sp1 : -12.70 -1.41 10 0.89 [bos] ! ! ! to ! , ! . [eos] cls3 - sp2 : -12.94 -1.44 10 0.89 [bos] ! ! ! to ! , telephone . [eos] cls3 - sp3 : -12.95 -1.44 10 1.00 [bos] ! ! ! to ! , telephone . [eos] cls3 - sp4 : -13.13 -1.46 10 1.00 [bos] ! ! ! to no , telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-29 src: none none 10 [bos] `` now listen to me , phil . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.07 /-0.99 /-50.08 /0.69/-0.69 -5.67 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.07 /-0.99 /-50.08 / /-0.69 -5.67 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt2: mod/noi/dif/loss/nce/logp -78.84 /-11.91 /-66.92 / /-17.54 -9.85 /-1.49 9 [bos] `` now listen to me , phil [eos] tgt3: mod/noi/dif/loss/nce/logp -70.52 /-11.33 /-59.19 / /-9.81 -7.84 /-1.26 10 [bos] `` now listen to , , phil . [eos] tgt4: mod/noi/dif/loss/nce/logp -88.73 /-12.17 /-76.55 / /-27.17 -8.87 /-1.22 11 [bos] `` now listen to me , phil . . [eos] tgt5: mod/noi/dif/loss/nce/logp -71.49 /-11.88 /-59.60 / /-10.22 -7.94 /-1.32 10 [bos] a now listen to me , phil . [eos] cls0 - sp0 : -14.33 -1.59 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp1 : -14.54 -1.62 10 0.11 [bos] ! ! ! to ! , ! . [eos] cls0 - sp2 : -14.84 -1.65 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp3 : -14.96 -1.66 10 0.11 [bos] ! ! ! to ! , ! . [eos] cls0 - sp4 : -14.98 -1.66 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls1 - sp0 : -13.88 -1.54 10 0.44 [bos] ! ! ! to ! , ! . [eos] cls1 - sp1 : -14.18 -1.58 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp2 : -14.28 -1.59 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp3 : -14.36 -1.60 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp4 : -14.83 -1.65 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls2 - sp0 : -13.46 -1.50 10 0.67 [bos] ! ! ! to ! , ! . [eos] cls2 - sp1 : -13.64 -1.52 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp2 : -13.73 -1.53 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp3 : -13.98 -1.55 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp4 : -14.06 -1.56 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls3 - sp0 : -12.42 -1.38 10 1.00 [bos] ! ! ! to ! , ! . [eos] cls3 - sp1 : -12.70 -1.41 10 0.89 [bos] ! ! ! to ! , ! . [eos] cls3 - sp2 : -12.94 -1.44 10 0.89 [bos] ! ! ! to ! , telephone . [eos] cls3 - sp3 : -12.95 -1.44 10 1.00 [bos] ! ! ! to ! , telephone . [eos] cls3 - sp4 : -13.13 -1.46 10 1.00 [bos] ! ! ! to no , telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-30 src: none none 10 [bos] `` now listen to me , phil . [eos] tgt0: mod/noi/dif/loss/nce/logp -41.98 /-0.99 /-40.99 /0.69/-0.69 -4.66 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt1: mod/noi/dif/loss/nce/logp -41.98 /-0.99 /-40.99 / /-0.69 -4.66 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt2: mod/noi/dif/loss/nce/logp -74.69 /-11.91 /-62.78 / /-22.48 -9.34 /-1.49 9 [bos] `` now listen to me , phil [eos] tgt3: mod/noi/dif/loss/nce/logp -61.42 /-11.33 /-50.09 / /-9.79 -6.82 /-1.26 10 [bos] `` now listen to , , phil . [eos] tgt4: mod/noi/dif/loss/nce/logp -77.97 /-12.17 /-65.80 / /-25.50 -7.80 /-1.22 11 [bos] `` now listen to me , phil . . [eos] tgt5: mod/noi/dif/loss/nce/logp -61.85 /-11.88 /-49.97 / /-9.67 -6.87 /-1.32 10 [bos] a now listen to me , phil . [eos] cls0 - sp0 : -14.38 -1.60 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp1 : -14.59 -1.62 10 0.22 [bos] ! ! ! to ! , couldn't . [eos] cls0 - sp2 : -14.84 -1.65 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp3 : -14.87 -1.65 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp4 : -14.92 -1.66 10 0.11 [bos] ! ! ! to ! , ! . [eos] cls1 - sp0 : -14.21 -1.58 10 0.44 [bos] ! ! ! to ! , ! . [eos] cls1 - sp1 : -14.22 -1.58 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp2 : -14.69 -1.63 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp3 : -14.84 -1.65 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp4 : -14.93 -1.66 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls2 - sp0 : -13.69 -1.52 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp1 : -14.08 -1.56 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp2 : -14.26 -1.58 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp3 : -14.50 -1.61 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp4 : -14.60 -1.62 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls3 - sp0 : -12.14 -1.35 10 0.89 [bos] ! ! ! to ! , ! . [eos] cls3 - sp1 : -12.40 -1.38 10 1.00 [bos] ! ! ! to ! , ! . [eos] cls3 - sp2 : -12.70 -1.41 10 0.89 [bos] ! ! ! to ! , property . [eos] cls3 - sp3 : -12.75 -1.42 10 0.89 [bos] ! ! ! to ! , telephone . [eos] cls3 - sp4 : -12.84 -1.43 10 0.89 [bos] ! ! ! to no , ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-31 src: none none 10 [bos] `` now listen to me , phil . [eos] tgt0: mod/noi/dif/loss/nce/logp -49.83 /-0.99 /-48.84 /0.69/-0.69 -5.54 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt1: mod/noi/dif/loss/nce/logp -49.83 /-0.99 /-48.84 / /-0.69 -5.54 /-0.11 10 [bos] `` now listen to me , phil . [eos] tgt2: mod/noi/dif/loss/nce/logp -78.97 /-11.91 /-67.06 / /-18.92 -9.87 /-1.49 9 [bos] `` now listen to me , phil [eos] tgt3: mod/noi/dif/loss/nce/logp -69.01 /-11.33 /-57.68 / /-9.54 -7.67 /-1.26 10 [bos] `` now listen to , , phil . [eos] tgt4: mod/noi/dif/loss/nce/logp -87.16 /-12.17 /-74.98 / /-26.84 -8.72 /-1.22 11 [bos] `` now listen to me , phil . . [eos] tgt5: mod/noi/dif/loss/nce/logp -68.63 /-11.88 /-56.75 / /-8.61 -7.63 /-1.32 10 [bos] a now listen to me , phil . [eos] cls0 - sp0 : -14.38 -1.60 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp1 : -14.59 -1.62 10 0.22 [bos] ! ! ! to ! , couldn't . [eos] cls0 - sp2 : -14.84 -1.65 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp3 : -14.87 -1.65 10 0.22 [bos] ! ! ! to ! , ! . [eos] cls0 - sp4 : -14.92 -1.66 10 0.11 [bos] ! ! ! to ! , ! . [eos] cls1 - sp0 : -14.21 -1.58 10 0.44 [bos] ! ! ! to ! , ! . [eos] cls1 - sp1 : -14.22 -1.58 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp2 : -14.69 -1.63 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp3 : -14.84 -1.65 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls1 - sp4 : -14.93 -1.66 10 0.33 [bos] ! ! ! to ! , ! . [eos] cls2 - sp0 : -13.69 -1.52 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp1 : -14.08 -1.56 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp2 : -14.26 -1.58 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp3 : -14.50 -1.61 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls2 - sp4 : -14.60 -1.62 10 0.56 [bos] ! ! ! to ! , ! . [eos] cls3 - sp0 : -12.14 -1.35 10 0.89 [bos] ! ! ! to ! , ! . [eos] cls3 - sp1 : -12.40 -1.38 10 1.00 [bos] ! ! ! to ! , ! . [eos] cls3 - sp2 : -12.70 -1.41 10 0.89 [bos] ! ! ! to ! , property . [eos] cls3 - sp3 : -12.75 -1.42 10 0.89 [bos] ! ! ! to ! , telephone . [eos] cls3 - sp4 : -12.84 -1.43 10 0.89 [bos] ! ! ! to no , ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-32 src: none none 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt0: mod/noi/dif/loss/nce/logp -83.42 /-2.04 /-81.39 /5.0/-5.00 -4.39 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt1: mod/noi/dif/loss/nce/logp -83.42 /-2.04 /-81.39 / /-5.00 -4.39 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt2: mod/noi/dif/loss/nce/logp -115.49/-13.00 /-102.49/ /-26.10 -6.42 /-0.72 19 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it [eos] tgt3: mod/noi/dif/loss/nce/logp -106.15/-13.20 /-92.95 / /-16.56 -5.59 /-0.69 20 [bos] i tell you when it's necessary to hurt of order to win -- you won't do it . [eos] tgt4: mod/noi/dif/loss/nce/logp -120.36/-13.14 /-107.22/ /-30.83 -6.02 /-0.66 21 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . . [eos] tgt5: mod/noi/dif/loss/nce/logp -90.04 /-13.64 /-76.40 / /-0.01 -4.74 /-0.72 20 [bos] i tell you when soggy necessary to hurt in order to win -- you won't do it . [eos] cls0 - sp0 : -25.58 -2.13 13 0.00 [bos] i 7 ! ! ! ! to couldn't in . ! [eos] cls0 - sp1 : -30.72 -2.56 13 0.08 [bos] i 7 ! ! ! ! to ! in . is [eos] cls0 - sp2 : -31.52 -1.85 18 0.18 [bos] ! ! ! ! ! ! to couldn't in be to . ! ! ! ! [eos] cls0 - sp3 : -31.63 -1.86 18 0.24 [bos] ! ! ! ! ! ! to couldn't in be to . ! ! ! ! [eos] cls0 - sp4 : -31.66 -1.86 18 0.18 [bos] ! ! ! ! ! ! to couldn't in ! to . ! ! ! ! [eos] cls1 - sp0 : -24.49 -2.04 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp1 : -28.21 -2.35 13 0.33 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp2 : -30.55 -2.55 13 0.42 [bos] ! ! ! ! ! ! to ! in . is [eos] cls1 - sp3 : -32.54 -1.91 18 0.29 [bos] ! ! ! ! ! ! to couldn't in be to . ! ! ! ! [eos] cls1 - sp4 : -32.57 -1.92 18 0.29 [bos] ! ! ! ! ! ! to couldn't in ! to . ! ! ! ! [eos] cls2 - sp0 : -33.26 -1.96 18 0.71 [bos] ! ! ! ! ! ! to ! in all to bidding -- ! ! ! [eos] cls2 - sp1 : -33.28 -1.96 18 0.65 [bos] ! ! ! ! ! ! to ! in all to bidding -- ! ! ! [eos] cls2 - sp2 : -33.37 -1.96 18 0.71 [bos] ! ! ! ! ! ! to ! in made to bidding -- ! ! ! [eos] cls2 - sp3 : -33.38 -1.96 18 0.65 [bos] ! ! ! ! ! ! to ! in made to bidding -- ! ! ! [eos] cls2 - sp4 : -33.42 -1.97 18 0.71 [bos] ! ! ! ! ! ! to ! in be to bidding -- ! ! ! [eos] cls3 - sp0 : -28.89 -1.52 20 1.00 [bos] ! ! ! ! ! ! to ! in all to telephone -- ! ! ! ! . [eos] cls3 - sp1 : -29.14 -1.53 20 1.00 [bos] ! ! ! ! ! ! to ! in made to telephone -- ! ! ! ! . [eos] cls3 - sp2 : -29.18 -1.54 20 1.00 [bos] ! ! ! ! ! ! to ! in all to discussed -- ! ! ! ! . [eos] cls3 - sp3 : -29.19 -1.54 20 1.00 [bos] ! ! ! ! ! ! to ! in be to telephone -- ! ! ! ! . [eos] cls3 - sp4 : -29.21 -1.54 20 1.00 [bos] ! ! ! ! ! ! to ! in all to mississippi -- ! ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-33 src: none none 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt0: mod/noi/dif/loss/nce/logp -88.58 /-2.04 /-86.54 /4.59/-4.59 -4.66 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt1: mod/noi/dif/loss/nce/logp -88.58 /-2.04 /-86.54 / /-4.59 -4.66 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt2: mod/noi/dif/loss/nce/logp -126.78/-13.00 /-113.78/ /-31.83 -7.04 /-0.72 19 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it [eos] tgt3: mod/noi/dif/loss/nce/logp -110.62/-13.20 /-97.41 / /-15.47 -5.82 /-0.69 20 [bos] i tell you when it's necessary to hurt of order to win -- you won't do it . [eos] tgt4: mod/noi/dif/loss/nce/logp -125.11/-13.14 /-111.98/ /-30.03 -6.26 /-0.66 21 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . . [eos] tgt5: mod/noi/dif/loss/nce/logp -95.60 /-13.64 /-81.97 / /-0.02 -5.03 /-0.72 20 [bos] i tell you when soggy necessary to hurt in order to win -- you won't do it . [eos] cls0 - sp0 : -25.58 -2.13 13 0.00 [bos] i 7 ! ! ! ! to couldn't in . ! [eos] cls0 - sp1 : -30.72 -2.56 13 0.08 [bos] i 7 ! ! ! ! to ! in . is [eos] cls0 - sp2 : -31.52 -1.85 18 0.18 [bos] ! ! ! ! ! ! to couldn't in be to . ! ! ! ! [eos] cls0 - sp3 : -31.63 -1.86 18 0.24 [bos] ! ! ! ! ! ! to couldn't in be to . ! ! ! ! [eos] cls0 - sp4 : -31.66 -1.86 18 0.18 [bos] ! ! ! ! ! ! to couldn't in ! to . ! ! ! ! [eos] cls1 - sp0 : -24.49 -2.04 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp1 : -28.21 -2.35 13 0.33 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp2 : -30.55 -2.55 13 0.42 [bos] ! ! ! ! ! ! to ! in . is [eos] cls1 - sp3 : -32.54 -1.91 18 0.29 [bos] ! ! ! ! ! ! to couldn't in be to . ! ! ! ! [eos] cls1 - sp4 : -32.57 -1.92 18 0.29 [bos] ! ! ! ! ! ! to couldn't in ! to . ! ! ! ! [eos] cls2 - sp0 : -33.26 -1.96 18 0.71 [bos] ! ! ! ! ! ! to ! in all to bidding -- ! ! ! [eos] cls2 - sp1 : -33.28 -1.96 18 0.65 [bos] ! ! ! ! ! ! to ! in all to bidding -- ! ! ! [eos] cls2 - sp2 : -33.37 -1.96 18 0.71 [bos] ! ! ! ! ! ! to ! in made to bidding -- ! ! ! [eos] cls2 - sp3 : -33.38 -1.96 18 0.65 [bos] ! ! ! ! ! ! to ! in made to bidding -- ! ! ! [eos] cls2 - sp4 : -33.42 -1.97 18 0.71 [bos] ! ! ! ! ! ! to ! in be to bidding -- ! ! ! [eos] cls3 - sp0 : -28.89 -1.52 20 1.00 [bos] ! ! ! ! ! ! to ! in all to telephone -- ! ! ! ! . [eos] cls3 - sp1 : -29.14 -1.53 20 1.00 [bos] ! ! ! ! ! ! to ! in made to telephone -- ! ! ! ! . [eos] cls3 - sp2 : -29.18 -1.54 20 1.00 [bos] ! ! ! ! ! ! to ! in all to discussed -- ! ! ! ! . [eos] cls3 - sp3 : -29.19 -1.54 20 1.00 [bos] ! ! ! ! ! ! to ! in be to telephone -- ! ! ! ! . [eos] cls3 - sp4 : -29.21 -1.54 20 1.00 [bos] ! ! ! ! ! ! to ! in all to mississippi -- ! ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-34 src: none none 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt0: mod/noi/dif/loss/nce/logp -79.64 /-2.04 /-77.61 /0.71/-0.71 -4.19 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt1: mod/noi/dif/loss/nce/logp -79.64 /-2.04 /-77.61 / /-0.71 -4.19 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt2: mod/noi/dif/loss/nce/logp -114.31/-13.00 /-101.32/ /-24.42 -6.35 /-0.72 19 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it [eos] tgt3: mod/noi/dif/loss/nce/logp -100.94/-13.20 /-87.74 / /-10.84 -5.31 /-0.69 20 [bos] i tell you when it's necessary to hurt of order to win -- you won't do it . [eos] tgt4: mod/noi/dif/loss/nce/logp -115.93/-13.14 /-102.79/ /-25.89 -5.80 /-0.66 21 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . . [eos] tgt5: mod/noi/dif/loss/nce/logp -94.62 /-13.64 /-80.99 / /-4.09 -4.98 /-0.72 20 [bos] i tell you when soggy necessary to hurt in order to win -- you won't do it . [eos] cls0 - sp0 : -23.17 -1.93 13 0.17 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp1 : -23.28 -1.94 13 0.17 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp2 : -23.35 -1.95 13 0.08 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp3 : -25.93 -2.16 13 0.17 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp4 : -30.02 -1.77 18 0.24 [bos] ! ! ! ! ! ! to couldn't in i to joined -- ! ! ! [eos] cls1 - sp0 : -23.08 -1.92 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp1 : -25.14 -2.10 13 0.33 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp2 : -25.43 -2.12 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp3 : -25.76 -2.15 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp4 : -29.89 -1.76 18 0.29 [bos] ! ! ! ! ! ! to couldn't in all to joined -- ! ! ! [eos] cls2 - sp0 : -29.17 -1.94 16 0.60 [bos] ! ! ! ! ! ! to ! in ! to couldn't -- ! [eos] cls2 - sp1 : -29.43 -1.73 18 0.65 [bos] ! ! ! ! ! ! to ! in ! to couldn't -- ! ! ! [eos] cls2 - sp2 : -29.66 -1.74 18 0.71 [bos] ! ! ! ! ! ! to ! in thought to couldn't -- ! ! ! [eos] cls2 - sp3 : -29.66 -1.74 18 0.71 [bos] ! ! ! ! ! ! to ! in all to couldn't -- ! ! ! [eos] cls2 - sp4 : -29.78 -1.75 18 0.59 [bos] ! ! ! ! ! ! to ! in ! to couldn't -- ! ! ! [eos] cls3 - sp0 : -24.13 -1.42 18 1.00 [bos] ! ! ! ! ! ! to ! in thought to first -- ! ! ! [eos] cls3 - sp1 : -24.30 -1.43 18 1.00 [bos] ! ! ! ! ! ! to ! in all to first -- ! ! ! [eos] cls3 - sp2 : -24.32 -1.43 18 1.00 [bos] ! ! ! ! ! ! to ! in thought to there -- ! ! ! [eos] cls3 - sp3 : -24.48 -1.44 18 1.00 [bos] ! ! ! ! ! ! to ! in all to there -- ! ! ! [eos] cls3 - sp4 : -24.53 -1.44 18 1.00 [bos] ! ! ! ! ! ! to ! in thought to almost -- ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-35 src: none none 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt0: mod/noi/dif/loss/nce/logp -86.80 /-2.04 /-84.77 /0.73/-0.73 -4.57 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt1: mod/noi/dif/loss/nce/logp -86.80 /-2.04 /-84.77 / /-0.73 -4.57 /-0.11 20 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . [eos] tgt2: mod/noi/dif/loss/nce/logp -125.73/-13.00 /-112.73/ /-28.69 -6.98 /-0.72 19 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it [eos] tgt3: mod/noi/dif/loss/nce/logp -107.58/-13.20 /-94.38 / /-10.34 -5.66 /-0.69 20 [bos] i tell you when it's necessary to hurt of order to win -- you won't do it . [eos] tgt4: mod/noi/dif/loss/nce/logp -123.29/-13.14 /-110.16/ /-26.12 -6.16 /-0.66 21 [bos] i tell you when it's necessary to hurt in order to win -- you won't do it . . [eos] tgt5: mod/noi/dif/loss/nce/logp -101.07/-13.64 /-87.44 / /-3.40 -5.32 /-0.72 20 [bos] i tell you when soggy necessary to hurt in order to win -- you won't do it . [eos] cls0 - sp0 : -23.17 -1.93 13 0.17 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp1 : -23.28 -1.94 13 0.17 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp2 : -23.35 -1.95 13 0.08 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp3 : -25.93 -2.16 13 0.17 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls0 - sp4 : -30.02 -1.77 18 0.24 [bos] ! ! ! ! ! ! to couldn't in i to joined -- ! ! ! [eos] cls1 - sp0 : -23.08 -1.92 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp1 : -25.14 -2.10 13 0.33 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp2 : -25.43 -2.12 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp3 : -25.76 -2.15 13 0.25 [bos] ! ! ! ! ! ! to couldn't in . ! [eos] cls1 - sp4 : -29.89 -1.76 18 0.29 [bos] ! ! ! ! ! ! to couldn't in all to joined -- ! ! ! [eos] cls2 - sp0 : -29.17 -1.94 16 0.60 [bos] ! ! ! ! ! ! to ! in ! to couldn't -- ! [eos] cls2 - sp1 : -29.43 -1.73 18 0.65 [bos] ! ! ! ! ! ! to ! in ! to couldn't -- ! ! ! [eos] cls2 - sp2 : -29.66 -1.74 18 0.71 [bos] ! ! ! ! ! ! to ! in thought to couldn't -- ! ! ! [eos] cls2 - sp3 : -29.66 -1.74 18 0.71 [bos] ! ! ! ! ! ! to ! in all to couldn't -- ! ! ! [eos] cls2 - sp4 : -29.78 -1.75 18 0.59 [bos] ! ! ! ! ! ! to ! in ! to couldn't -- ! ! ! [eos] cls3 - sp0 : -24.13 -1.42 18 1.00 [bos] ! ! ! ! ! ! to ! in thought to first -- ! ! ! [eos] cls3 - sp1 : -24.30 -1.43 18 1.00 [bos] ! ! ! ! ! ! to ! in all to first -- ! ! ! [eos] cls3 - sp2 : -24.32 -1.43 18 1.00 [bos] ! ! ! ! ! ! to ! in thought to there -- ! ! ! [eos] cls3 - sp3 : -24.48 -1.44 18 1.00 [bos] ! ! ! ! ! ! to ! in all to there -- ! ! ! [eos] cls3 - sp4 : -24.53 -1.44 18 1.00 [bos] ! ! ! ! ! ! to ! in thought to almost -- ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-36 src: none none 6 [bos] baseball's no cinch . [eos] tgt0: mod/noi/dif/loss/nce/logp -36.19 /-0.44 /-35.75 /0.69/-0.69 -7.24 /-0.09 6 [bos] baseball's no cinch . [eos] tgt1: mod/noi/dif/loss/nce/logp -36.19 /-0.44 /-35.75 / /-0.69 -7.24 /-0.09 6 [bos] baseball's no cinch . [eos] tgt2: mod/noi/dif/loss/nce/logp -57.02 /-11.30 /-45.73 / /-10.67 -14.26/-2.82 5 [bos] baseball's no cinch [eos] tgt3: mod/noi/dif/loss/nce/logp -72.18 /-11.54 /-60.64 / /-25.58 -12.03/-1.92 7 [bos] baseball's no cinch . . [eos] tgt4: mod/noi/dif/loss/nce/logp -54.95 /-11.15 /-43.79 / /-8.73 -10.99/-2.23 6 [bos] baseball's [unk] cinch . [eos] tgt5: mod/noi/dif/loss/nce/logp -57.65 /-11.98 /-45.67 / /-10.62 -11.53/-2.40 6 [bos] baseball's no cinch , [eos] cls0 - sp0 : -7.62 -1.52 6 0.00 [bos] she no ! . [eos] cls0 - sp1 : -7.87 -1.57 6 0.00 [bos] she no no . [eos] cls0 - sp2 : -8.18 -1.64 6 0.20 [bos] ! ! ! . [eos] cls0 - sp3 : -8.19 -1.64 6 0.00 [bos] i no no . [eos] cls0 - sp4 : -8.28 -1.66 6 0.00 [bos] couldn't no ! . [eos] cls1 - sp0 : -8.52 -1.70 6 0.40 [bos] ! ! ! . [eos] cls1 - sp1 : -8.80 -1.76 6 0.40 [bos] ! ! ! . [eos] cls1 - sp2 : -9.52 -1.90 6 0.40 [bos] don't no ! . [eos] cls1 - sp3 : -9.58 -1.92 6 0.40 [bos] ! ! ! . [eos] cls1 - sp4 : -9.60 -1.92 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -8.10 -1.62 6 0.60 [bos] ! ! ! . [eos] cls2 - sp1 : -8.17 -1.63 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -8.38 -1.68 6 0.60 [bos] ! ! ! . [eos] cls2 - sp3 : -8.38 -1.68 6 0.60 [bos] ! ! ! . [eos] cls2 - sp4 : -9.53 -2.38 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -6.94 -1.39 6 0.80 [bos] ! ! ! . [eos] cls3 - sp1 : -7.50 -1.50 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.05 -1.61 6 0.80 [bos] we no no . [eos] cls3 - sp3 : -8.06 -1.61 6 0.80 [bos] she no no . [eos] cls3 - sp4 : -8.41 -1.68 6 0.80 [bos] we no ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-37 src: none none 6 [bos] baseball's no cinch . [eos] tgt0: mod/noi/dif/loss/nce/logp -44.44 /-0.44 /-44.00 /0.69/-0.69 -8.89 /-0.09 6 [bos] baseball's no cinch . [eos] tgt1: mod/noi/dif/loss/nce/logp -44.44 /-0.44 /-44.00 / /-0.69 -8.89 /-0.09 6 [bos] baseball's no cinch . [eos] tgt2: mod/noi/dif/loss/nce/logp -69.40 /-11.30 /-58.10 / /-14.79 -17.35/-2.82 5 [bos] baseball's no cinch [eos] tgt3: mod/noi/dif/loss/nce/logp -82.21 /-11.54 /-70.67 / /-27.36 -13.70/-1.92 7 [bos] baseball's no cinch . . [eos] tgt4: mod/noi/dif/loss/nce/logp -64.20 /-11.15 /-53.05 / /-9.74 -12.84/-2.23 6 [bos] baseball's [unk] cinch . [eos] tgt5: mod/noi/dif/loss/nce/logp -63.25 /-11.98 /-51.27 / /-7.96 -12.65/-2.40 6 [bos] baseball's no cinch , [eos] cls0 - sp0 : -7.62 -1.52 6 0.00 [bos] she no ! . [eos] cls0 - sp1 : -7.87 -1.57 6 0.00 [bos] she no no . [eos] cls0 - sp2 : -8.18 -1.64 6 0.20 [bos] ! ! ! . [eos] cls0 - sp3 : -8.19 -1.64 6 0.00 [bos] i no no . [eos] cls0 - sp4 : -8.28 -1.66 6 0.00 [bos] couldn't no ! . [eos] cls1 - sp0 : -8.52 -1.70 6 0.40 [bos] ! ! ! . [eos] cls1 - sp1 : -8.80 -1.76 6 0.40 [bos] ! ! ! . [eos] cls1 - sp2 : -9.52 -1.90 6 0.40 [bos] don't no ! . [eos] cls1 - sp3 : -9.58 -1.92 6 0.40 [bos] ! ! ! . [eos] cls1 - sp4 : -9.60 -1.92 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -8.10 -1.62 6 0.60 [bos] ! ! ! . [eos] cls2 - sp1 : -8.17 -1.63 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -8.38 -1.68 6 0.60 [bos] ! ! ! . [eos] cls2 - sp3 : -8.38 -1.68 6 0.60 [bos] ! ! ! . [eos] cls2 - sp4 : -9.53 -2.38 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -6.94 -1.39 6 0.80 [bos] ! ! ! . [eos] cls3 - sp1 : -7.50 -1.50 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.05 -1.61 6 0.80 [bos] we no no . [eos] cls3 - sp3 : -8.06 -1.61 6 0.80 [bos] she no no . [eos] cls3 - sp4 : -8.41 -1.68 6 0.80 [bos] we no ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-38 src: none none 6 [bos] baseball's no cinch . [eos] tgt0: mod/noi/dif/loss/nce/logp -35.10 /-0.44 /-34.66 /0.69/-0.69 -7.02 /-0.09 6 [bos] baseball's no cinch . [eos] tgt1: mod/noi/dif/loss/nce/logp -35.10 /-0.44 /-34.66 / /-0.69 -7.02 /-0.09 6 [bos] baseball's no cinch . [eos] tgt2: mod/noi/dif/loss/nce/logp -57.99 /-11.30 /-46.69 / /-12.72 -14.50/-2.82 5 [bos] baseball's no cinch [eos] tgt3: mod/noi/dif/loss/nce/logp -70.17 /-11.54 /-58.63 / /-24.66 -11.70/-1.92 7 [bos] baseball's no cinch . . [eos] tgt4: mod/noi/dif/loss/nce/logp -53.83 /-11.15 /-42.68 / /-8.71 -10.77/-2.23 6 [bos] baseball's [unk] cinch . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.09 /-11.98 /-46.11 / /-12.14 -11.62/-2.40 6 [bos] baseball's no cinch , [eos] cls0 - sp0 : -7.27 -1.45 6 0.00 [bos] she no no . [eos] cls0 - sp1 : -7.76 -1.55 6 0.00 [bos] i no no . [eos] cls0 - sp2 : -7.83 -1.57 6 0.00 [bos] she no ! . [eos] cls0 - sp3 : -7.90 -1.58 6 0.00 [bos] she no i . [eos] cls0 - sp4 : -8.02 -1.60 6 0.00 [bos] she no later . [eos] cls1 - sp0 : -7.40 -1.48 6 0.40 [bos] ! ! ! . [eos] cls1 - sp1 : -7.63 -1.53 6 0.40 [bos] ! ! ! . [eos] cls1 - sp2 : -9.16 -1.83 6 0.40 [bos] ! ! ! . [eos] cls1 - sp3 : -9.27 -1.85 6 0.40 [bos] ! ! no . [eos] cls1 - sp4 : -9.34 -1.87 6 0.40 [bos] ! no ! . [eos] cls2 - sp0 : -7.12 -1.42 6 0.60 [bos] ! ! ! . [eos] cls2 - sp1 : -7.96 -1.59 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -9.51 -2.38 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -11.78 -2.36 6 0.60 [bos] ! ! ! . [eos] cls2 - sp4 : -11.88 -2.38 6 0.60 [bos] ! ! ! . [eos] cls3 - sp0 : -7.02 -1.40 6 0.80 [bos] ! ! ! . [eos] cls3 - sp1 : -7.04 -1.41 6 0.80 [bos] she no no . [eos] cls3 - sp2 : -7.06 -1.41 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -7.47 -1.49 6 0.80 [bos] we no no . [eos] cls3 - sp4 : -7.78 -1.56 6 0.80 [bos] don't no no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-39 src: none none 6 [bos] baseball's no cinch . [eos] tgt0: mod/noi/dif/loss/nce/logp -43.28 /-0.44 /-42.84 /0.69/-0.69 -8.66 /-0.09 6 [bos] baseball's no cinch . [eos] tgt1: mod/noi/dif/loss/nce/logp -43.28 /-0.44 /-42.84 / /-0.69 -8.66 /-0.09 6 [bos] baseball's no cinch . [eos] tgt2: mod/noi/dif/loss/nce/logp -69.57 /-11.30 /-58.27 / /-16.12 -17.39/-2.82 5 [bos] baseball's no cinch [eos] tgt3: mod/noi/dif/loss/nce/logp -80.34 /-11.54 /-68.80 / /-26.65 -13.39/-1.92 7 [bos] baseball's no cinch . . [eos] tgt4: mod/noi/dif/loss/nce/logp -63.44 /-11.15 /-52.29 / /-10.14 -12.69/-2.23 6 [bos] baseball's [unk] cinch . [eos] tgt5: mod/noi/dif/loss/nce/logp -62.96 /-11.98 /-50.98 / /-8.83 -12.59/-2.40 6 [bos] baseball's no cinch , [eos] cls0 - sp0 : -7.27 -1.45 6 0.00 [bos] she no no . [eos] cls0 - sp1 : -7.76 -1.55 6 0.00 [bos] i no no . [eos] cls0 - sp2 : -7.83 -1.57 6 0.00 [bos] she no ! . [eos] cls0 - sp3 : -7.90 -1.58 6 0.00 [bos] she no i . [eos] cls0 - sp4 : -8.02 -1.60 6 0.00 [bos] she no later . [eos] cls1 - sp0 : -7.40 -1.48 6 0.40 [bos] ! ! ! . [eos] cls1 - sp1 : -7.63 -1.53 6 0.40 [bos] ! ! ! . [eos] cls1 - sp2 : -9.16 -1.83 6 0.40 [bos] ! ! ! . [eos] cls1 - sp3 : -9.27 -1.85 6 0.40 [bos] ! ! no . [eos] cls1 - sp4 : -9.34 -1.87 6 0.40 [bos] ! no ! . [eos] cls2 - sp0 : -7.12 -1.42 6 0.60 [bos] ! ! ! . [eos] cls2 - sp1 : -7.96 -1.59 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -9.51 -2.38 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -11.78 -2.36 6 0.60 [bos] ! ! ! . [eos] cls2 - sp4 : -11.88 -2.38 6 0.60 [bos] ! ! ! . [eos] cls3 - sp0 : -7.02 -1.40 6 0.80 [bos] ! ! ! . [eos] cls3 - sp1 : -7.04 -1.41 6 0.80 [bos] she no no . [eos] cls3 - sp2 : -7.06 -1.41 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -7.47 -1.49 6 0.80 [bos] we no no . [eos] cls3 - sp4 : -7.78 -1.56 6 0.80 [bos] don't no no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-40 src: none none 5 [bos] eddie nodded . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.97 /-0.38 /-31.58 /0.88/-0.88 -7.99 /-0.10 5 [bos] eddie nodded . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.97 /-0.38 /-31.58 / /-0.88 -7.99 /-0.10 5 [bos] eddie nodded . [eos] tgt2: mod/noi/dif/loss/nce/logp -63.74 /-11.25 /-52.49 / /-21.79 -21.25/-3.75 4 [bos] eddie nodded [eos] tgt3: mod/noi/dif/loss/nce/logp -66.30 /-11.58 /-54.72 / /-24.02 -13.26/-2.32 6 [bos] eddie nodded . . [eos] tgt4: mod/noi/dif/loss/nce/logp -51.80 /-11.93 /-39.87 / /-9.17 -12.95/-2.98 5 [bos] eddie nodded , [eos] tgt5: mod/noi/dif/loss/nce/logp -44.41 /-11.93 /-32.47 / /-1.77 -11.10/-2.98 5 [bos] eddie nodded '' [eos] cls0 - sp0 : -6.35 -1.59 5 0.00 [bos] she no . [eos] cls0 - sp1 : -6.47 -1.62 5 0.00 [bos] i no . [eos] cls0 - sp2 : -6.94 -1.73 5 0.00 [bos] couldn't no . [eos] cls0 - sp3 : -7.02 -1.76 5 0.00 [bos] we no . [eos] cls0 - sp4 : -7.06 -1.77 5 0.00 [bos] no no . [eos] cls1 - sp0 : -6.75 -1.69 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -7.21 -1.80 5 0.25 [bos] ! no . [eos] cls1 - sp2 : -7.29 -1.82 5 0.25 [bos] ! ! . [eos] cls1 - sp3 : -8.11 -2.03 5 0.25 [bos] no no . [eos] cls1 - sp4 : -8.32 -2.08 5 0.25 [bos] ! no . [eos] cls2 - sp0 : -5.84 -1.46 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -7.48 -1.87 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -8.67 -2.17 5 0.50 [bos] don't no . [eos] cls2 - sp3 : -8.67 -2.17 5 0.50 [bos] 7 no . [eos] cls2 - sp4 : -8.78 -2.20 5 0.50 [bos] ! ! no [eos] cls3 - sp0 : -7.12 -1.78 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -7.38 -1.84 5 0.75 [bos] 7 no . [eos] cls3 - sp2 : -7.41 -1.85 5 0.75 [bos] we no . [eos] cls3 - sp3 : -7.48 -1.87 5 0.75 [bos] ! no . [eos] cls3 - sp4 : -7.50 -1.87 5 0.75 [bos] don't no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-41 src: none none 5 [bos] eddie nodded . [eos] tgt0: mod/noi/dif/loss/nce/logp -37.88 /-0.38 /-37.50 /0.7/-0.70 -9.47 /-0.10 5 [bos] eddie nodded . [eos] tgt1: mod/noi/dif/loss/nce/logp -37.88 /-0.38 /-37.50 / /-0.70 -9.47 /-0.10 5 [bos] eddie nodded . [eos] tgt2: mod/noi/dif/loss/nce/logp -59.37 /-11.25 /-48.12 / /-11.32 -19.79/-3.75 4 [bos] eddie nodded [eos] tgt3: mod/noi/dif/loss/nce/logp -76.26 /-11.58 /-64.69 / /-27.88 -15.25/-2.32 6 [bos] eddie nodded . . [eos] tgt4: mod/noi/dif/loss/nce/logp -58.94 /-11.93 /-47.02 / /-10.21 -14.74/-2.98 5 [bos] eddie nodded , [eos] tgt5: mod/noi/dif/loss/nce/logp -54.73 /-11.93 /-42.80 / /-5.99 -13.68/-2.98 5 [bos] eddie nodded '' [eos] cls0 - sp0 : -6.35 -1.59 5 0.00 [bos] she no . [eos] cls0 - sp1 : -6.47 -1.62 5 0.00 [bos] i no . [eos] cls0 - sp2 : -6.94 -1.73 5 0.00 [bos] couldn't no . [eos] cls0 - sp3 : -7.02 -1.76 5 0.00 [bos] we no . [eos] cls0 - sp4 : -7.06 -1.77 5 0.00 [bos] no no . [eos] cls1 - sp0 : -6.75 -1.69 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -7.21 -1.80 5 0.25 [bos] ! no . [eos] cls1 - sp2 : -7.29 -1.82 5 0.25 [bos] ! ! . [eos] cls1 - sp3 : -8.11 -2.03 5 0.25 [bos] no no . [eos] cls1 - sp4 : -8.32 -2.08 5 0.25 [bos] ! no . [eos] cls2 - sp0 : -5.84 -1.46 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -7.48 -1.87 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -8.67 -2.17 5 0.50 [bos] don't no . [eos] cls2 - sp3 : -8.67 -2.17 5 0.50 [bos] 7 no . [eos] cls2 - sp4 : -8.78 -2.20 5 0.50 [bos] ! ! no [eos] cls3 - sp0 : -7.12 -1.78 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -7.38 -1.84 5 0.75 [bos] 7 no . [eos] cls3 - sp2 : -7.41 -1.85 5 0.75 [bos] we no . [eos] cls3 - sp3 : -7.48 -1.87 5 0.75 [bos] ! no . [eos] cls3 - sp4 : -7.50 -1.87 5 0.75 [bos] don't no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-42 src: none none 5 [bos] eddie nodded . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.75 /-0.38 /-31.37 /0.82/-0.82 -7.94 /-0.10 5 [bos] eddie nodded . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.75 /-0.38 /-31.37 / /-0.82 -7.94 /-0.10 5 [bos] eddie nodded . [eos] tgt2: mod/noi/dif/loss/nce/logp -66.08 /-11.25 /-54.83 / /-24.28 -22.03/-3.75 4 [bos] eddie nodded [eos] tgt3: mod/noi/dif/loss/nce/logp -64.90 /-11.58 /-53.32 / /-22.77 -12.98/-2.32 6 [bos] eddie nodded . . [eos] tgt4: mod/noi/dif/loss/nce/logp -53.68 /-11.93 /-41.75 / /-11.21 -13.42/-2.98 5 [bos] eddie nodded , [eos] tgt5: mod/noi/dif/loss/nce/logp -44.60 /-11.93 /-32.67 / /-2.12 -11.15/-2.98 5 [bos] eddie nodded '' [eos] cls0 - sp0 : -6.64 -1.66 5 0.00 [bos] ! ! . [eos] cls0 - sp1 : -7.13 -1.78 5 0.00 [bos] she no . [eos] cls0 - sp2 : -7.46 -1.87 5 0.00 [bos] she later . [eos] cls0 - sp3 : -7.58 -1.89 5 0.00 [bos] i no . [eos] cls0 - sp4 : -7.91 -1.98 5 0.00 [bos] she joined . [eos] cls1 - sp0 : -6.21 -1.55 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -7.03 -1.76 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -8.07 -2.02 5 0.25 [bos] ! couldn't . [eos] cls1 - sp3 : -8.12 -2.03 5 0.25 [bos] ! no . [eos] cls1 - sp4 : -8.19 -2.05 5 0.25 [bos] ! later . [eos] cls2 - sp0 : -5.84 -1.46 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -8.07 -2.02 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -8.63 -2.16 5 0.50 [bos] 7 ! . [eos] cls2 - sp3 : -9.03 -2.26 5 0.50 [bos] ! later . [eos] cls2 - sp4 : -9.31 -2.33 5 0.50 [bos] no no . [eos] cls3 - sp0 : -7.34 -1.83 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -8.07 -2.02 5 0.75 [bos] ! no . [eos] cls3 - sp2 : -8.08 -2.02 5 0.75 [bos] 7 no . [eos] cls3 - sp3 : -8.11 -2.03 5 0.75 [bos] don't no . [eos] cls3 - sp4 : -8.12 -2.03 5 0.75 [bos] we later . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-43 src: none none 5 [bos] eddie nodded . [eos] tgt0: mod/noi/dif/loss/nce/logp -38.09 /-0.38 /-37.71 /0.69/-0.69 -9.52 /-0.10 5 [bos] eddie nodded . [eos] tgt1: mod/noi/dif/loss/nce/logp -38.09 /-0.38 /-37.71 / /-0.69 -9.52 /-0.10 5 [bos] eddie nodded . [eos] tgt2: mod/noi/dif/loss/nce/logp -62.51 /-11.25 /-51.26 / /-14.24 -20.84/-3.75 4 [bos] eddie nodded [eos] tgt3: mod/noi/dif/loss/nce/logp -75.71 /-11.58 /-64.13 / /-27.12 -15.14/-2.32 6 [bos] eddie nodded . . [eos] tgt4: mod/noi/dif/loss/nce/logp -60.68 /-11.93 /-48.75 / /-11.74 -15.17/-2.98 5 [bos] eddie nodded , [eos] tgt5: mod/noi/dif/loss/nce/logp -55.80 /-11.93 /-43.86 / /-6.85 -13.95/-2.98 5 [bos] eddie nodded '' [eos] cls0 - sp0 : -6.64 -1.66 5 0.00 [bos] ! ! . [eos] cls0 - sp1 : -7.13 -1.78 5 0.00 [bos] she no . [eos] cls0 - sp2 : -7.46 -1.87 5 0.00 [bos] she later . [eos] cls0 - sp3 : -7.58 -1.89 5 0.00 [bos] i no . [eos] cls0 - sp4 : -7.91 -1.98 5 0.00 [bos] she joined . [eos] cls1 - sp0 : -6.21 -1.55 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -7.03 -1.76 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -8.07 -2.02 5 0.25 [bos] ! couldn't . [eos] cls1 - sp3 : -8.12 -2.03 5 0.25 [bos] ! no . [eos] cls1 - sp4 : -8.19 -2.05 5 0.25 [bos] ! later . [eos] cls2 - sp0 : -5.84 -1.46 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -8.07 -2.02 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -8.63 -2.16 5 0.50 [bos] 7 ! . [eos] cls2 - sp3 : -9.03 -2.26 5 0.50 [bos] ! later . [eos] cls2 - sp4 : -9.31 -2.33 5 0.50 [bos] no no . [eos] cls3 - sp0 : -7.34 -1.83 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -8.07 -2.02 5 0.75 [bos] ! no . [eos] cls3 - sp2 : -8.08 -2.02 5 0.75 [bos] 7 no . [eos] cls3 - sp3 : -8.11 -2.03 5 0.75 [bos] don't no . [eos] cls3 - sp4 : -8.12 -2.03 5 0.75 [bos] we later . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-44 src: none none 8 [bos] `` what for '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -10.30 /-0.88 /-9.43 /0.69/-0.69 -1.47 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -10.30 /-0.88 /-9.43 / /-0.69 -1.47 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -57.79 /-11.09 /-46.70 / /-37.97 -9.63 /-1.85 7 [bos] `` what for '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -47.86 /-11.37 /-36.49 / /-27.76 -9.57 /-2.27 6 [bos] `` what for '' [eos] tgt4: mod/noi/dif/loss/nce/logp -34.94 /-11.36 /-23.58 / /-14.84 -4.99 /-1.62 8 [bos] `` what for '' ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -83.33 /-11.19 /-72.14 / /-63.41 -13.89/-1.87 7 [bos] `` what for '' . [eos] cls0 - sp0 : -6.33 -0.90 8 0.00 [bos] she ) for '' ? ? [eos] cls0 - sp1 : -7.25 -1.04 8 0.00 [bos] when ) for '' ? ? [eos] cls0 - sp2 : -7.46 -1.07 8 0.00 [bos] she it for '' ? ? [eos] cls0 - sp3 : -7.58 -1.08 8 0.00 [bos] when it for '' ? ? [eos] cls0 - sp4 : -7.70 -1.10 8 0.00 [bos] when any for '' ? ? [eos] cls1 - sp0 : -8.38 -1.20 8 0.29 [bos] ! ! for '' ? ? [eos] cls1 - sp1 : -8.92 -1.27 8 0.43 [bos] ! ! for '' ? ? [eos] cls1 - sp2 : -9.07 -1.30 8 0.29 [bos] ! ! : '' ? ? [eos] cls1 - sp3 : -9.35 -1.34 8 0.43 [bos] ! ! for '' ? ? [eos] cls1 - sp4 : -9.54 -1.36 8 0.43 [bos] ! ! : '' ? ? [eos] cls2 - sp0 : -8.58 -1.23 8 0.71 [bos] ! ! for '' ? ? [eos] cls2 - sp1 : -9.18 -1.31 8 0.57 [bos] ! ! for '' ? ? [eos] cls2 - sp2 : -9.43 -1.35 8 0.71 [bos] ! ! : '' ? ? [eos] cls2 - sp3 : -9.43 -1.35 8 0.57 [bos] ! ! for '' ? ? [eos] cls2 - sp4 : -9.44 -1.35 8 0.57 [bos] ! ! for '' ? ? [eos] cls3 - sp0 : -6.33 -0.90 8 1.00 [bos] she ) for '' ? ? [eos] cls3 - sp1 : -6.88 -0.98 8 1.00 [bos] ! ! for '' ? ? [eos] cls3 - sp2 : -7.48 -1.07 8 1.00 [bos] ! ! : '' ? ? [eos] cls3 - sp3 : -7.59 -1.08 8 1.00 [bos] she ) : '' ? ? [eos] cls3 - sp4 : -7.61 -1.09 8 1.00 [bos] she though for '' ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-45 src: none none 8 [bos] `` what for '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -11.56 /-0.88 /-10.69 /0.69/-0.69 -1.65 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -11.56 /-0.88 /-10.69 / /-0.69 -1.65 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -54.13 /-11.09 /-43.04 / /-33.05 -9.02 /-1.85 7 [bos] `` what for '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -49.10 /-11.37 /-37.74 / /-27.74 -9.82 /-2.27 6 [bos] `` what for '' [eos] tgt4: mod/noi/dif/loss/nce/logp -35.22 /-11.36 /-23.86 / /-13.86 -5.03 /-1.62 8 [bos] `` what for '' ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -92.52 /-11.19 /-81.32 / /-71.33 -15.42/-1.87 7 [bos] `` what for '' . [eos] cls0 - sp0 : -6.33 -0.90 8 0.00 [bos] she ) for '' ? ? [eos] cls0 - sp1 : -7.25 -1.04 8 0.00 [bos] when ) for '' ? ? [eos] cls0 - sp2 : -7.46 -1.07 8 0.00 [bos] she it for '' ? ? [eos] cls0 - sp3 : -7.58 -1.08 8 0.00 [bos] when it for '' ? ? [eos] cls0 - sp4 : -7.70 -1.10 8 0.00 [bos] when any for '' ? ? [eos] cls1 - sp0 : -8.38 -1.20 8 0.29 [bos] ! ! for '' ? ? [eos] cls1 - sp1 : -8.92 -1.27 8 0.43 [bos] ! ! for '' ? ? [eos] cls1 - sp2 : -9.07 -1.30 8 0.29 [bos] ! ! : '' ? ? [eos] cls1 - sp3 : -9.35 -1.34 8 0.43 [bos] ! ! for '' ? ? [eos] cls1 - sp4 : -9.54 -1.36 8 0.43 [bos] ! ! : '' ? ? [eos] cls2 - sp0 : -8.58 -1.23 8 0.71 [bos] ! ! for '' ? ? [eos] cls2 - sp1 : -9.18 -1.31 8 0.57 [bos] ! ! for '' ? ? [eos] cls2 - sp2 : -9.43 -1.35 8 0.71 [bos] ! ! : '' ? ? [eos] cls2 - sp3 : -9.43 -1.35 8 0.57 [bos] ! ! for '' ? ? [eos] cls2 - sp4 : -9.44 -1.35 8 0.57 [bos] ! ! for '' ? ? [eos] cls3 - sp0 : -6.33 -0.90 8 1.00 [bos] she ) for '' ? ? [eos] cls3 - sp1 : -6.88 -0.98 8 1.00 [bos] ! ! for '' ? ? [eos] cls3 - sp2 : -7.48 -1.07 8 1.00 [bos] ! ! : '' ? ? [eos] cls3 - sp3 : -7.59 -1.08 8 1.00 [bos] she ) : '' ? ? [eos] cls3 - sp4 : -7.61 -1.09 8 1.00 [bos] she though for '' ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-46 src: none none 8 [bos] `` what for '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -11.51 /-0.88 /-10.63 /0.69/-0.69 -1.64 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -11.51 /-0.88 /-10.63 / /-0.69 -1.64 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -58.49 /-11.09 /-47.40 / /-37.46 -9.75 /-1.85 7 [bos] `` what for '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -46.99 /-11.37 /-35.63 / /-25.69 -9.40 /-2.27 6 [bos] `` what for '' [eos] tgt4: mod/noi/dif/loss/nce/logp -30.64 /-11.36 /-19.28 / /-9.34 -4.38 /-1.62 8 [bos] `` what for '' ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -76.96 /-11.19 /-65.77 / /-55.83 -12.83/-1.87 7 [bos] `` what for '' . [eos] cls0 - sp0 : -7.12 -1.02 8 0.00 [bos] i no for '' ? ? [eos] cls0 - sp1 : -7.25 -1.04 8 0.00 [bos] when no for '' ? ? [eos] cls0 - sp2 : -7.30 -1.04 8 0.00 [bos] she ) for '' ? ? [eos] cls0 - sp3 : -7.78 -1.11 8 0.00 [bos] i any for '' ? ? [eos] cls0 - sp4 : -7.95 -1.14 8 0.00 [bos] she any for '' ? ? [eos] cls1 - sp0 : -8.43 -1.20 8 0.43 [bos] ! ! ! '' ? ? [eos] cls1 - sp1 : -8.47 -1.21 8 0.29 [bos] ! ! ! '' ? ? [eos] cls1 - sp2 : -8.59 -1.23 8 0.29 [bos] ! ! ! '' ? ? [eos] cls1 - sp3 : -8.65 -1.24 8 0.29 [bos] ! ! ! '' ? ? [eos] cls1 - sp4 : -8.95 -1.28 8 0.29 [bos] ! ! ! ! ? ? [eos] cls2 - sp0 : -7.46 -1.07 8 0.71 [bos] ! ! ! ! ? ? [eos] cls2 - sp1 : -7.68 -1.10 8 0.71 [bos] ! ! ! '' ? ? [eos] cls2 - sp2 : -7.70 -1.10 8 0.71 [bos] ! ! ! '' ? ? [eos] cls2 - sp3 : -8.09 -1.16 8 0.57 [bos] ! ! ! '' ? ? [eos] cls2 - sp4 : -8.16 -1.17 8 0.57 [bos] ! ! ! '' ? ? [eos] cls3 - sp0 : -6.41 -0.92 8 1.00 [bos] ! ! ! '' ? ? [eos] cls3 - sp1 : -6.75 -0.96 8 1.00 [bos] she ) for '' ? ? [eos] cls3 - sp2 : -7.20 -1.03 8 0.86 [bos] ! ! ! '' ? ? [eos] cls3 - sp3 : -7.31 -0.81 10 1.00 [bos] she no for '' ? ? ? ? [eos] cls3 - sp4 : -7.36 -1.05 8 0.86 [bos] ! ! ! '' ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-47 src: none none 8 [bos] `` what for '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -20.76 /-0.88 /-19.89 /0.78/-0.78 -2.97 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -20.76 /-0.88 /-19.89 / /-0.78 -2.97 /-0.13 8 [bos] `` what for '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -60.62 /-11.09 /-49.53 / /-30.43 -10.10/-1.85 7 [bos] `` what for '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -52.65 /-11.37 /-41.29 / /-22.18 -10.53/-2.27 6 [bos] `` what for '' [eos] tgt4: mod/noi/dif/loss/nce/logp -32.91 /-11.36 /-21.55 / /-2.44 -4.70 /-1.62 8 [bos] `` what for '' ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -80.50 /-11.19 /-69.30 / /-50.20 -13.42/-1.87 7 [bos] `` what for '' . [eos] cls0 - sp0 : -7.12 -1.02 8 0.00 [bos] i no for '' ? ? [eos] cls0 - sp1 : -7.25 -1.04 8 0.00 [bos] when no for '' ? ? [eos] cls0 - sp2 : -7.30 -1.04 8 0.00 [bos] she ) for '' ? ? [eos] cls0 - sp3 : -7.78 -1.11 8 0.00 [bos] i any for '' ? ? [eos] cls0 - sp4 : -7.95 -1.14 8 0.00 [bos] she any for '' ? ? [eos] cls1 - sp0 : -8.43 -1.20 8 0.43 [bos] ! ! ! '' ? ? [eos] cls1 - sp1 : -8.47 -1.21 8 0.29 [bos] ! ! ! '' ? ? [eos] cls1 - sp2 : -8.59 -1.23 8 0.29 [bos] ! ! ! '' ? ? [eos] cls1 - sp3 : -8.65 -1.24 8 0.29 [bos] ! ! ! '' ? ? [eos] cls1 - sp4 : -8.95 -1.28 8 0.29 [bos] ! ! ! ! ? ? [eos] cls2 - sp0 : -7.46 -1.07 8 0.71 [bos] ! ! ! ! ? ? [eos] cls2 - sp1 : -7.68 -1.10 8 0.71 [bos] ! ! ! '' ? ? [eos] cls2 - sp2 : -7.70 -1.10 8 0.71 [bos] ! ! ! '' ? ? [eos] cls2 - sp3 : -8.09 -1.16 8 0.57 [bos] ! ! ! '' ? ? [eos] cls2 - sp4 : -8.16 -1.17 8 0.57 [bos] ! ! ! '' ? ? [eos] cls3 - sp0 : -6.41 -0.92 8 1.00 [bos] ! ! ! '' ? ? [eos] cls3 - sp1 : -6.75 -0.96 8 1.00 [bos] she ) for '' ? ? [eos] cls3 - sp2 : -7.20 -1.03 8 0.86 [bos] ! ! ! '' ? ? [eos] cls3 - sp3 : -7.31 -0.81 10 1.00 [bos] she no for '' ? ? ? ? [eos] cls3 - sp4 : -7.36 -1.05 8 0.86 [bos] ! ! ! '' ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-48 src: none none 7 [bos] frankie shook his head . [eos] tgt0: mod/noi/dif/loss/nce/logp -40.27 /-0.59 /-39.68 /0.69/-0.69 -6.71 /-0.10 7 [bos] frankie shook his head . [eos] tgt1: mod/noi/dif/loss/nce/logp -40.27 /-0.59 /-39.68 / /-0.69 -6.71 /-0.10 7 [bos] frankie shook his head . [eos] tgt2: mod/noi/dif/loss/nce/logp -65.19 /-12.46 /-52.73 / /-13.75 -10.87/-2.08 7 [bos] frankie shook fifty head . [eos] tgt3: mod/noi/dif/loss/nce/logp -70.10 /-11.59 /-58.50 / /-19.52 -14.02/-2.32 6 [bos] frankie shook his head [eos] tgt4: mod/noi/dif/loss/nce/logp -75.20 /-11.69 /-63.51 / /-24.53 -10.74/-1.67 8 [bos] frankie shook his head . . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.78 /-11.45 /-47.33 / /-8.34 -9.80 /-1.91 7 [bos] frankie shook the head . [eos] cls0 - sp0 : -5.41 -2.70 3 0.00 [bos] ! [eos] cls0 - sp1 : -11.90 -1.98 7 0.00 [bos] she ) his no . [eos] cls0 - sp2 : -12.20 -2.03 7 0.00 [bos] she ) his later . [eos] cls0 - sp3 : -12.31 -2.05 7 0.00 [bos] she ) his ! . [eos] cls0 - sp4 : -12.33 -2.05 7 0.00 [bos] i no his no . [eos] cls1 - sp0 : -12.48 -2.08 7 0.33 [bos] she ) his ! . [eos] cls1 - sp1 : -12.87 -2.15 7 0.33 [bos] she 4 his ! . [eos] cls1 - sp2 : -12.93 -2.15 7 0.33 [bos] she dr. his ! . [eos] cls1 - sp3 : -13.07 -2.18 7 0.33 [bos] she ) his no . [eos] cls1 - sp4 : -13.22 -2.20 7 0.33 [bos] she pain his ! . [eos] cls2 - sp0 : -6.62 -3.31 3 0.50 [bos] ! [eos] cls2 - sp1 : -12.14 -2.02 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp2 : -12.22 -2.04 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp3 : -13.40 -2.23 7 0.50 [bos] ! ! his ! ! [eos] cls2 - sp4 : -13.68 -2.28 7 0.50 [bos] ! ! his ! . [eos] cls3 - sp0 : -10.84 -1.81 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp1 : -11.61 -1.93 7 0.83 [bos] she ) his ! . [eos] cls3 - sp2 : -11.72 -1.95 7 0.83 [bos] she 7 his ! . [eos] cls3 - sp3 : -11.91 -1.98 7 0.83 [bos] she ) his no . [eos] cls3 - sp4 : -12.16 -2.03 7 0.83 [bos] she corner his no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-49 src: none none 7 [bos] frankie shook his head . [eos] tgt0: mod/noi/dif/loss/nce/logp -48.87 /-0.59 /-48.28 /0.69/-0.69 -8.14 /-0.10 7 [bos] frankie shook his head . [eos] tgt1: mod/noi/dif/loss/nce/logp -48.87 /-0.59 /-48.28 / /-0.69 -8.14 /-0.10 7 [bos] frankie shook his head . [eos] tgt2: mod/noi/dif/loss/nce/logp -74.26 /-12.46 /-61.80 / /-14.22 -12.38/-2.08 7 [bos] frankie shook fifty head . [eos] tgt3: mod/noi/dif/loss/nce/logp -73.27 /-11.59 /-61.67 / /-14.09 -14.65/-2.32 6 [bos] frankie shook his head [eos] tgt4: mod/noi/dif/loss/nce/logp -85.25 /-11.69 /-73.56 / /-25.98 -12.18/-1.67 8 [bos] frankie shook his head . . [eos] tgt5: mod/noi/dif/loss/nce/logp -66.57 /-11.45 /-55.12 / /-7.54 -11.10/-1.91 7 [bos] frankie shook the head . [eos] cls0 - sp0 : -5.41 -2.70 3 0.00 [bos] ! [eos] cls0 - sp1 : -11.90 -1.98 7 0.00 [bos] she ) his no . [eos] cls0 - sp2 : -12.20 -2.03 7 0.00 [bos] she ) his later . [eos] cls0 - sp3 : -12.31 -2.05 7 0.00 [bos] she ) his ! . [eos] cls0 - sp4 : -12.33 -2.05 7 0.00 [bos] i no his no . [eos] cls1 - sp0 : -12.48 -2.08 7 0.33 [bos] she ) his ! . [eos] cls1 - sp1 : -12.87 -2.15 7 0.33 [bos] she 4 his ! . [eos] cls1 - sp2 : -12.93 -2.15 7 0.33 [bos] she dr. his ! . [eos] cls1 - sp3 : -13.07 -2.18 7 0.33 [bos] she ) his no . [eos] cls1 - sp4 : -13.22 -2.20 7 0.33 [bos] she pain his ! . [eos] cls2 - sp0 : -6.62 -3.31 3 0.50 [bos] ! [eos] cls2 - sp1 : -12.14 -2.02 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp2 : -12.22 -2.04 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp3 : -13.40 -2.23 7 0.50 [bos] ! ! his ! ! [eos] cls2 - sp4 : -13.68 -2.28 7 0.50 [bos] ! ! his ! . [eos] cls3 - sp0 : -10.84 -1.81 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp1 : -11.61 -1.93 7 0.83 [bos] she ) his ! . [eos] cls3 - sp2 : -11.72 -1.95 7 0.83 [bos] she 7 his ! . [eos] cls3 - sp3 : -11.91 -1.98 7 0.83 [bos] she ) his no . [eos] cls3 - sp4 : -12.16 -2.03 7 0.83 [bos] she corner his no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-50 src: none none 7 [bos] frankie shook his head . [eos] tgt0: mod/noi/dif/loss/nce/logp -42.34 /-0.59 /-41.75 /0.7/-0.70 -7.06 /-0.10 7 [bos] frankie shook his head . [eos] tgt1: mod/noi/dif/loss/nce/logp -42.34 /-0.59 /-41.75 / /-0.70 -7.06 /-0.10 7 [bos] frankie shook his head . [eos] tgt2: mod/noi/dif/loss/nce/logp -64.86 /-12.46 /-52.40 / /-11.35 -10.81/-2.08 7 [bos] frankie shook fifty head . [eos] tgt3: mod/noi/dif/loss/nce/logp -72.80 /-11.59 /-61.21 / /-20.15 -14.56/-2.32 6 [bos] frankie shook his head [eos] tgt4: mod/noi/dif/loss/nce/logp -75.16 /-11.69 /-63.47 / /-22.41 -10.74/-1.67 8 [bos] frankie shook his head . . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.58 /-11.45 /-47.13 / /-6.07 -9.76 /-1.91 7 [bos] frankie shook the head . [eos] cls0 - sp0 : -12.86 -2.14 7 0.00 [bos] i no his ! . [eos] cls0 - sp1 : -12.96 -2.16 7 0.00 [bos] she no his ! . [eos] cls0 - sp2 : -13.06 -2.18 7 0.00 [bos] i no his mean . [eos] cls0 - sp3 : -13.12 -2.19 7 0.00 [bos] i no his later . [eos] cls0 - sp4 : -13.19 -2.20 7 0.00 [bos] she joined his ! . [eos] cls1 - sp0 : -13.86 -2.31 7 0.33 [bos] she 7 his ! . [eos] cls1 - sp1 : -13.88 -2.31 7 0.33 [bos] ! 7 his ! . [eos] cls1 - sp2 : -13.93 -2.32 7 0.33 [bos] i 7 his ! . [eos] cls1 - sp3 : -13.95 -2.32 7 0.33 [bos] she joined his ! . [eos] cls1 - sp4 : -14.01 -2.34 7 0.33 [bos] ! ! his ! . [eos] cls2 - sp0 : -12.44 -2.07 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp1 : -12.54 -2.09 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp2 : -12.57 -2.10 7 0.67 [bos] ! 7 his ! . [eos] cls2 - sp3 : -12.58 -2.10 7 0.50 [bos] ! 7 his ! . [eos] cls2 - sp4 : -12.66 -2.11 7 0.67 [bos] ! 7 his ! . [eos] cls3 - sp0 : -11.32 -1.89 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp1 : -11.68 -1.95 7 0.83 [bos] no 7 his ! . [eos] cls3 - sp2 : -12.14 -2.02 7 0.83 [bos] ! 7 his ! . [eos] cls3 - sp3 : -12.19 -2.03 7 0.83 [bos] no we his ! . [eos] cls3 - sp4 : -12.63 -2.11 7 0.83 [bos] ! 7 his ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-51 src: none none 7 [bos] frankie shook his head . [eos] tgt0: mod/noi/dif/loss/nce/logp -50.36 /-0.59 /-49.77 /0.7/-0.70 -8.39 /-0.10 7 [bos] frankie shook his head . [eos] tgt1: mod/noi/dif/loss/nce/logp -50.36 /-0.59 /-49.77 / /-0.70 -8.39 /-0.10 7 [bos] frankie shook his head . [eos] tgt2: mod/noi/dif/loss/nce/logp -74.19 /-12.46 /-61.73 / /-12.65 -12.36/-2.08 7 [bos] frankie shook fifty head . [eos] tgt3: mod/noi/dif/loss/nce/logp -76.68 /-11.59 /-65.08 / /-16.01 -15.34/-2.32 6 [bos] frankie shook his head [eos] tgt4: mod/noi/dif/loss/nce/logp -85.47 /-11.69 /-73.78 / /-24.70 -12.21/-1.67 8 [bos] frankie shook his head . . [eos] tgt5: mod/noi/dif/loss/nce/logp -66.11 /-11.45 /-54.65 / /-5.58 -11.02/-1.91 7 [bos] frankie shook the head . [eos] cls0 - sp0 : -12.86 -2.14 7 0.00 [bos] i no his ! . [eos] cls0 - sp1 : -12.96 -2.16 7 0.00 [bos] she no his ! . [eos] cls0 - sp2 : -13.06 -2.18 7 0.00 [bos] i no his mean . [eos] cls0 - sp3 : -13.12 -2.19 7 0.00 [bos] i no his later . [eos] cls0 - sp4 : -13.19 -2.20 7 0.00 [bos] she joined his ! . [eos] cls1 - sp0 : -13.86 -2.31 7 0.33 [bos] she 7 his ! . [eos] cls1 - sp1 : -13.88 -2.31 7 0.33 [bos] ! 7 his ! . [eos] cls1 - sp2 : -13.93 -2.32 7 0.33 [bos] i 7 his ! . [eos] cls1 - sp3 : -13.95 -2.32 7 0.33 [bos] she joined his ! . [eos] cls1 - sp4 : -14.01 -2.34 7 0.33 [bos] ! ! his ! . [eos] cls2 - sp0 : -12.44 -2.07 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp1 : -12.54 -2.09 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp2 : -12.57 -2.10 7 0.67 [bos] ! 7 his ! . [eos] cls2 - sp3 : -12.58 -2.10 7 0.50 [bos] ! 7 his ! . [eos] cls2 - sp4 : -12.66 -2.11 7 0.67 [bos] ! 7 his ! . [eos] cls3 - sp0 : -11.32 -1.89 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp1 : -11.68 -1.95 7 0.83 [bos] no 7 his ! . [eos] cls3 - sp2 : -12.14 -2.02 7 0.83 [bos] ! 7 his ! . [eos] cls3 - sp3 : -12.19 -2.03 7 0.83 [bos] no we his ! . [eos] cls3 - sp4 : -12.63 -2.11 7 0.83 [bos] ! 7 his ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-52 src: none none 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.77 /-1.37 /-30.40 /0.69/-0.69 -2.65 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.77 /-1.37 /-30.40 / /-0.69 -2.65 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt2: mod/noi/dif/loss/nce/logp -150.11/-11.75 /-138.35/ /-108.65 -18.76/-1.47 9 [bos] `` don't take it like this . [eos] tgt3: mod/noi/dif/loss/nce/logp -47.52 /-11.38 /-36.14 / /-6.43 -3.96 /-0.95 13 [bos] `` don't that it like this '' , frankie said . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.50 /-12.53 /-57.97 / /-28.27 -5.42 /-0.96 14 [bos] `` don't take it like this '' , frankie said . . [eos] tgt5: mod/noi/dif/loss/nce/logp -59.81 /-12.30 /-47.51 / /-17.81 -5.44 /-1.12 12 [bos] `` don't take it like this '' , frankie said [eos] cls0 - sp0 : -18.96 -1.58 13 0.00 [bos] '' no any it on this '' , cleaning had . [eos] cls0 - sp1 : -19.07 -1.59 13 0.00 [bos] '' no no it on this '' , cleaning had . [eos] cls0 - sp2 : -19.14 -1.59 13 0.00 [bos] when no any it on this '' , cleaning had . [eos] cls0 - sp3 : -19.15 -1.60 13 0.00 [bos] she no any it on this '' , cleaning had . [eos] cls0 - sp4 : -19.19 -1.60 13 0.00 [bos] '' no take it on this '' , cleaning had . [eos] cls1 - sp0 : -19.76 -2.20 10 0.44 [bos] ! ! ! ! ! ! '' , [eos] cls1 - sp1 : -21.41 -1.78 13 0.33 [bos] : ! ! ! ! ! '' , ! had . [eos] cls1 - sp2 : -21.42 -1.79 13 0.42 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls1 - sp3 : -21.69 -1.81 13 0.33 [bos] : ! ! ) ! ! '' , ! had . [eos] cls1 - sp4 : -21.81 -1.82 13 0.33 [bos] : ! ! ! ! ! '' , ! or . [eos] cls2 - sp0 : -19.25 -2.14 10 0.56 [bos] ! ! ! ! ! ! '' , [eos] cls2 - sp1 : -19.49 -2.17 10 0.67 [bos] ! ! ! ! ! ! '' , [eos] cls2 - sp2 : -21.50 -1.79 13 0.50 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls2 - sp3 : -22.09 -2.01 12 0.55 [bos] ! ! ! ! ! ! '' , ! ! [eos] cls2 - sp4 : -22.27 -1.86 13 0.58 [bos] ! ! ! ! ! ! '' , ! ! ! [eos] cls3 - sp0 : -19.53 -1.63 13 1.00 [bos] she ! ) ) on this '' , telephone had . [eos] cls3 - sp1 : -19.56 -1.63 13 1.00 [bos] she ! ) ) her this '' , telephone had . [eos] cls3 - sp2 : -19.59 -1.63 13 1.00 [bos] she no any it on this '' , telephone had . [eos] cls3 - sp3 : -19.60 -1.63 13 1.00 [bos] she ! ) ) on this '' , mississippi had . [eos] cls3 - sp4 : -19.67 -1.64 13 1.00 [bos] she ! ) ) her this '' , mississippi had . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-53 src: none none 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt0: mod/noi/dif/loss/nce/logp -30.63 /-1.37 /-29.26 /0.69/-0.69 -2.55 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt1: mod/noi/dif/loss/nce/logp -30.63 /-1.37 /-29.26 / /-0.69 -2.55 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt2: mod/noi/dif/loss/nce/logp -139.83/-11.75 /-128.07/ /-99.50 -17.48/-1.47 9 [bos] `` don't take it like this . [eos] tgt3: mod/noi/dif/loss/nce/logp -46.97 /-11.38 /-35.59 / /-7.03 -3.91 /-0.95 13 [bos] `` don't that it like this '' , frankie said . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.07 /-12.53 /-57.54 / /-28.97 -5.39 /-0.96 14 [bos] `` don't take it like this '' , frankie said . . [eos] tgt5: mod/noi/dif/loss/nce/logp -62.08 /-12.30 /-49.78 / /-21.21 -5.64 /-1.12 12 [bos] `` don't take it like this '' , frankie said [eos] cls0 - sp0 : -18.96 -1.58 13 0.00 [bos] '' no any it on this '' , cleaning had . [eos] cls0 - sp1 : -19.07 -1.59 13 0.00 [bos] '' no no it on this '' , cleaning had . [eos] cls0 - sp2 : -19.14 -1.59 13 0.00 [bos] when no any it on this '' , cleaning had . [eos] cls0 - sp3 : -19.15 -1.60 13 0.00 [bos] she no any it on this '' , cleaning had . [eos] cls0 - sp4 : -19.19 -1.60 13 0.00 [bos] '' no take it on this '' , cleaning had . [eos] cls1 - sp0 : -19.76 -2.20 10 0.44 [bos] ! ! ! ! ! ! '' , [eos] cls1 - sp1 : -21.41 -1.78 13 0.33 [bos] : ! ! ! ! ! '' , ! had . [eos] cls1 - sp2 : -21.42 -1.79 13 0.42 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls1 - sp3 : -21.69 -1.81 13 0.33 [bos] : ! ! ) ! ! '' , ! had . [eos] cls1 - sp4 : -21.81 -1.82 13 0.33 [bos] : ! ! ! ! ! '' , ! or . [eos] cls2 - sp0 : -19.25 -2.14 10 0.56 [bos] ! ! ! ! ! ! '' , [eos] cls2 - sp1 : -19.49 -2.17 10 0.67 [bos] ! ! ! ! ! ! '' , [eos] cls2 - sp2 : -21.50 -1.79 13 0.50 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls2 - sp3 : -22.09 -2.01 12 0.55 [bos] ! ! ! ! ! ! '' , ! ! [eos] cls2 - sp4 : -22.27 -1.86 13 0.58 [bos] ! ! ! ! ! ! '' , ! ! ! [eos] cls3 - sp0 : -19.53 -1.63 13 1.00 [bos] she ! ) ) on this '' , telephone had . [eos] cls3 - sp1 : -19.56 -1.63 13 1.00 [bos] she ! ) ) her this '' , telephone had . [eos] cls3 - sp2 : -19.59 -1.63 13 1.00 [bos] she no any it on this '' , telephone had . [eos] cls3 - sp3 : -19.60 -1.63 13 1.00 [bos] she ! ) ) on this '' , mississippi had . [eos] cls3 - sp4 : -19.67 -1.64 13 1.00 [bos] she ! ) ) her this '' , mississippi had . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-54 src: none none 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt0: mod/noi/dif/loss/nce/logp -32.86 /-1.37 /-31.49 /0.69/-0.69 -2.74 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt1: mod/noi/dif/loss/nce/logp -32.86 /-1.37 /-31.49 / /-0.69 -2.74 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt2: mod/noi/dif/loss/nce/logp -151.70/-11.75 /-139.94/ /-109.15 -18.96/-1.47 9 [bos] `` don't take it like this . [eos] tgt3: mod/noi/dif/loss/nce/logp -48.71 /-11.38 /-37.33 / /-6.54 -4.06 /-0.95 13 [bos] `` don't that it like this '' , frankie said . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.56 /-12.53 /-58.03 / /-27.24 -5.43 /-0.96 14 [bos] `` don't take it like this '' , frankie said . . [eos] tgt5: mod/noi/dif/loss/nce/logp -60.85 /-12.30 /-48.55 / /-17.75 -5.53 /-1.12 12 [bos] `` don't take it like this '' , frankie said [eos] cls0 - sp0 : -19.98 -1.67 13 0.00 [bos] when no any it it this '' , joined had . [eos] cls0 - sp1 : -20.03 -1.67 13 0.00 [bos] when no any it it this '' , streets had . [eos] cls0 - sp2 : -20.05 -1.67 13 0.00 [bos] when no any it has this '' , joined had . [eos] cls0 - sp3 : -20.06 -1.67 13 0.00 [bos] when no any it it this '' , cleaning had . [eos] cls0 - sp4 : -20.06 -1.67 13 0.00 [bos] when no any it has this '' , editor or . [eos] cls1 - sp0 : -20.78 -2.08 11 0.30 [bos] ! ! ! ! ! ! '' , ! [eos] cls1 - sp1 : -21.34 -2.13 11 0.40 [bos] ! ! ! ! ! ! '' , ! [eos] cls1 - sp2 : -21.35 -1.78 13 0.42 [bos] ! ! ! ! ! ! '' , ! ! . [eos] cls1 - sp3 : -21.36 -1.78 13 0.33 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls1 - sp4 : -21.40 -1.78 13 0.33 [bos] ! ! ! ! ! ! '' , ! or . [eos] cls2 - sp0 : -19.82 -1.98 11 0.50 [bos] ! ! ! ! ! ! '' , ! [eos] cls2 - sp1 : -19.86 -1.66 13 0.58 [bos] ! ! ! ! ! ! '' , ! or . [eos] cls2 - sp2 : -20.03 -1.67 13 0.58 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls2 - sp3 : -20.33 -1.69 13 0.58 [bos] ! ! ! ! ! ! '' , ! ! . [eos] cls2 - sp4 : -20.37 -1.70 13 0.50 [bos] ! ! ! ! ! ! '' , ! or . [eos] cls3 - sp0 : -19.05 -1.59 13 1.00 [bos] ! ! ! ! ! ! '' , ! at . [eos] cls3 - sp1 : -19.10 -1.59 13 1.00 [bos] ! ! ! ! ! ! '' , ! ! ! [eos] cls3 - sp2 : -19.13 -1.59 13 0.92 [bos] ! ! ! ! ! ! '' , ! at . [eos] cls3 - sp3 : -19.24 -1.60 13 1.00 [bos] ! ! ) it ! ! '' , ! at . [eos] cls3 - sp4 : -19.24 -1.75 12 1.00 [bos] ! ! ! ! ! ! '' , ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-55 src: none none 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt0: mod/noi/dif/loss/nce/logp -32.18 /-1.37 /-30.81 /0.69/-0.69 -2.68 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt1: mod/noi/dif/loss/nce/logp -32.18 /-1.37 /-30.81 / /-0.69 -2.68 /-0.11 13 [bos] `` don't take it like this '' , frankie said . [eos] tgt2: mod/noi/dif/loss/nce/logp -141.54/-11.75 /-129.78/ /-99.66 -17.69/-1.47 9 [bos] `` don't take it like this . [eos] tgt3: mod/noi/dif/loss/nce/logp -48.51 /-11.38 /-37.12 / /-7.01 -4.04 /-0.95 13 [bos] `` don't that it like this '' , frankie said . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.84 /-12.53 /-58.32 / /-28.20 -5.45 /-0.96 14 [bos] `` don't take it like this '' , frankie said . . [eos] tgt5: mod/noi/dif/loss/nce/logp -63.53 /-12.30 /-51.22 / /-21.11 -5.78 /-1.12 12 [bos] `` don't take it like this '' , frankie said [eos] cls0 - sp0 : -19.98 -1.67 13 0.00 [bos] when no any it it this '' , joined had . [eos] cls0 - sp1 : -20.03 -1.67 13 0.00 [bos] when no any it it this '' , streets had . [eos] cls0 - sp2 : -20.05 -1.67 13 0.00 [bos] when no any it has this '' , joined had . [eos] cls0 - sp3 : -20.06 -1.67 13 0.00 [bos] when no any it it this '' , cleaning had . [eos] cls0 - sp4 : -20.06 -1.67 13 0.00 [bos] when no any it has this '' , editor or . [eos] cls1 - sp0 : -20.78 -2.08 11 0.30 [bos] ! ! ! ! ! ! '' , ! [eos] cls1 - sp1 : -21.34 -2.13 11 0.40 [bos] ! ! ! ! ! ! '' , ! [eos] cls1 - sp2 : -21.35 -1.78 13 0.42 [bos] ! ! ! ! ! ! '' , ! ! . [eos] cls1 - sp3 : -21.36 -1.78 13 0.33 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls1 - sp4 : -21.40 -1.78 13 0.33 [bos] ! ! ! ! ! ! '' , ! or . [eos] cls2 - sp0 : -19.82 -1.98 11 0.50 [bos] ! ! ! ! ! ! '' , ! [eos] cls2 - sp1 : -19.86 -1.66 13 0.58 [bos] ! ! ! ! ! ! '' , ! or . [eos] cls2 - sp2 : -20.03 -1.67 13 0.58 [bos] ! ! ! ! ! ! '' , ! had . [eos] cls2 - sp3 : -20.33 -1.69 13 0.58 [bos] ! ! ! ! ! ! '' , ! ! . [eos] cls2 - sp4 : -20.37 -1.70 13 0.50 [bos] ! ! ! ! ! ! '' , ! or . [eos] cls3 - sp0 : -19.05 -1.59 13 1.00 [bos] ! ! ! ! ! ! '' , ! at . [eos] cls3 - sp1 : -19.10 -1.59 13 1.00 [bos] ! ! ! ! ! ! '' , ! ! ! [eos] cls3 - sp2 : -19.13 -1.59 13 0.92 [bos] ! ! ! ! ! ! '' , ! at . [eos] cls3 - sp3 : -19.24 -1.60 13 1.00 [bos] ! ! ) it ! ! '' , ! at . [eos] cls3 - sp4 : -19.24 -1.75 12 1.00 [bos] ! ! ! ! ! ! '' , ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-56 src: none none 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -69.93 /-1.61 /-68.32 /0.69/-0.69 -4.66 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -69.93 /-1.61 /-68.32 / /-0.69 -4.66 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -118.34/-12.03 /-106.31/ /-38.69 -8.45 /-0.86 15 [bos] what the hell right did eddie have saying a thing like that ? [eos] tgt3: mod/noi/dif/loss/nce/logp -172.98/-11.84 /-161.14/ /-93.52 -28.83/-1.97 7 [bos] what the hell right . [eos] tgt4: mod/noi/dif/loss/nce/logp -96.55 /-12.08 /-84.48 / /-16.85 -6.44 /-0.81 16 [bos] what the hell right did eddie have saying a thing like that ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -94.04 /-12.77 /-81.27 / /-13.65 -6.27 /-0.85 16 [bos] what the hell right did eddie have saying the thing like that ? ? [eos] cls0 - sp0 : -23.60 -1.97 13 0.17 [bos] ! the i ! ! ! ! ! a ! ! [eos] cls0 - sp1 : -25.62 -2.14 13 0.00 [bos] we the couldn't ! up couldn't have ! a ! ! [eos] cls0 - sp2 : -25.74 -2.15 13 0.00 [bos] we the couldn't ! up editor have ! a ! ! [eos] cls0 - sp3 : -27.29 -1.82 16 0.07 [bos] we the couldn't ! up editor have ! a ! ! that ? ? [eos] cls0 - sp4 : -27.32 -1.82 16 0.07 [bos] we the couldn't ! up couldn't have ! a ! ! that ? ? [eos] cls1 - sp0 : -22.80 -1.90 13 0.33 [bos] ! the couldn't ! ! ! ! ! a ! ! [eos] cls1 - sp1 : -22.90 -1.91 13 0.33 [bos] ! the i ! ! ! ! ! a ! ! [eos] cls1 - sp2 : -22.96 -1.91 13 0.33 [bos] ! the she ! ! ! ! ! a ! ! [eos] cls1 - sp3 : -25.03 -1.67 16 0.40 [bos] ! the couldn't ! ! ! ! ! a ! ! that ? ? [eos] cls1 - sp4 : -25.07 -1.67 16 0.40 [bos] ! the i ! ! ! ! ! a ! ! that ? ? [eos] cls2 - sp0 : -21.24 -1.77 13 0.67 [bos] ! the ! ! ! ! ! ! a ! ! [eos] cls2 - sp1 : -21.33 -1.78 13 0.58 [bos] ! the ! ! ! ! ! ! a ! ! [eos] cls2 - sp2 : -21.53 -1.79 13 0.67 [bos] ! the ! ! ; ! ! ! a ! ! [eos] cls2 - sp3 : -21.70 -1.45 16 0.73 [bos] ! the ! ! ! ! ! ! a ! ! that ? ? [eos] cls2 - sp4 : -22.07 -1.47 16 0.73 [bos] ! the ! ! ; ! ! ! a ! ! that ? ? [eos] cls3 - sp0 : -19.87 -1.66 13 0.92 [bos] ! the don't ! ; ! ! ! a ! ! [eos] cls3 - sp1 : -20.63 -1.38 16 0.93 [bos] ! the don't ! ; ! ! ! a ! ! that ? ? [eos] cls3 - sp2 : -20.99 -1.75 13 0.75 [bos] ! the ! ! ! ! ! ! a ! ! [eos] cls3 - sp3 : -21.20 -1.41 16 1.00 [bos] ! the don't ! ; ! ! ! a ! ! that ? ? [eos] cls3 - sp4 : -21.31 -1.78 13 0.75 [bos] ! the ! ! ; ! ! ! a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-57 src: none none 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -68.05 /-1.61 /-66.44 /0.69/-0.69 -4.54 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -68.05 /-1.61 /-66.44 / /-0.69 -4.54 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -114.88/-12.03 /-102.85/ /-37.10 -8.21 /-0.86 15 [bos] what the hell right did eddie have saying a thing like that ? [eos] tgt3: mod/noi/dif/loss/nce/logp -177.09/-11.84 /-165.25/ /-99.50 -29.52/-1.97 7 [bos] what the hell right . [eos] tgt4: mod/noi/dif/loss/nce/logp -98.68 /-12.08 /-86.60 / /-20.86 -6.58 /-0.81 16 [bos] what the hell right did eddie have saying a thing like that ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.73 /-12.77 /-78.96 / /-13.22 -6.12 /-0.85 16 [bos] what the hell right did eddie have saying the thing like that ? ? [eos] cls0 - sp0 : -23.60 -1.97 13 0.17 [bos] ! the i ! ! ! ! ! a ! ! [eos] cls0 - sp1 : -25.62 -2.14 13 0.00 [bos] we the couldn't ! up couldn't have ! a ! ! [eos] cls0 - sp2 : -25.74 -2.15 13 0.00 [bos] we the couldn't ! up editor have ! a ! ! [eos] cls0 - sp3 : -27.29 -1.82 16 0.07 [bos] we the couldn't ! up editor have ! a ! ! that ? ? [eos] cls0 - sp4 : -27.32 -1.82 16 0.07 [bos] we the couldn't ! up couldn't have ! a ! ! that ? ? [eos] cls1 - sp0 : -22.80 -1.90 13 0.33 [bos] ! the couldn't ! ! ! ! ! a ! ! [eos] cls1 - sp1 : -22.90 -1.91 13 0.33 [bos] ! the i ! ! ! ! ! a ! ! [eos] cls1 - sp2 : -22.96 -1.91 13 0.33 [bos] ! the she ! ! ! ! ! a ! ! [eos] cls1 - sp3 : -25.03 -1.67 16 0.40 [bos] ! the couldn't ! ! ! ! ! a ! ! that ? ? [eos] cls1 - sp4 : -25.07 -1.67 16 0.40 [bos] ! the i ! ! ! ! ! a ! ! that ? ? [eos] cls2 - sp0 : -21.24 -1.77 13 0.67 [bos] ! the ! ! ! ! ! ! a ! ! [eos] cls2 - sp1 : -21.33 -1.78 13 0.58 [bos] ! the ! ! ! ! ! ! a ! ! [eos] cls2 - sp2 : -21.53 -1.79 13 0.67 [bos] ! the ! ! ; ! ! ! a ! ! [eos] cls2 - sp3 : -21.70 -1.45 16 0.73 [bos] ! the ! ! ! ! ! ! a ! ! that ? ? [eos] cls2 - sp4 : -22.07 -1.47 16 0.73 [bos] ! the ! ! ; ! ! ! a ! ! that ? ? [eos] cls3 - sp0 : -19.87 -1.66 13 0.92 [bos] ! the don't ! ; ! ! ! a ! ! [eos] cls3 - sp1 : -20.63 -1.38 16 0.93 [bos] ! the don't ! ; ! ! ! a ! ! that ? ? [eos] cls3 - sp2 : -20.99 -1.75 13 0.75 [bos] ! the ! ! ! ! ! ! a ! ! [eos] cls3 - sp3 : -21.20 -1.41 16 1.00 [bos] ! the don't ! ; ! ! ! a ! ! that ? ? [eos] cls3 - sp4 : -21.31 -1.78 13 0.75 [bos] ! the ! ! ; ! ! ! a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-58 src: none none 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -70.34 /-1.61 /-68.72 /0.69/-0.69 -4.69 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -70.34 /-1.61 /-68.72 / /-0.69 -4.69 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -114.92/-12.03 /-102.89/ /-34.86 -8.21 /-0.86 15 [bos] what the hell right did eddie have saying a thing like that ? [eos] tgt3: mod/noi/dif/loss/nce/logp -154.91/-11.84 /-143.07/ /-75.04 -25.82/-1.97 7 [bos] what the hell right . [eos] tgt4: mod/noi/dif/loss/nce/logp -108.81/-12.08 /-96.73 / /-28.70 -7.25 /-0.81 16 [bos] what the hell right did eddie have saying a thing like that ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -93.75 /-12.77 /-80.98 / /-12.95 -6.25 /-0.85 16 [bos] what the hell right did eddie have saying the thing like that ? ? [eos] cls0 - sp0 : -17.10 -1.90 10 0.22 [bos] ! the ! ! ! ! ! ! [eos] cls0 - sp1 : -17.47 -1.94 10 0.22 [bos] ! the ! ! ! ! ! ! [eos] cls0 - sp2 : -17.50 -1.94 10 0.11 [bos] we the ! ! ! ! ! ! [eos] cls0 - sp3 : -17.55 -1.95 10 0.00 [bos] we the ! ! ! ! ! ! [eos] cls0 - sp4 : -17.65 -1.96 10 0.11 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp0 : -16.27 -1.81 10 0.44 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp1 : -16.72 -1.86 10 0.44 [bos] ! ! ! ! ! ! ! ! [eos] cls1 - sp2 : -16.92 -1.88 10 0.33 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp3 : -16.94 -1.88 10 0.33 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp4 : -16.95 -1.88 10 0.33 [bos] ! the ! ! ! ! ! ! [eos] cls2 - sp0 : -14.78 -1.64 10 0.67 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp1 : -15.13 -1.68 10 0.67 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp2 : -15.59 -1.73 10 0.56 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp3 : -15.97 -1.77 10 0.56 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp4 : -16.23 -1.80 10 0.56 [bos] ! the ! ! ! ! ! ! [eos] cls3 - sp0 : -13.54 -1.50 10 1.00 [bos] ! ? ! ! ! ! ! ! [eos] cls3 - sp1 : -14.20 -1.58 10 0.89 [bos] ! ? ! ! ! ! ! ! [eos] cls3 - sp2 : -14.24 -1.58 10 0.89 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp3 : -14.35 -1.59 10 0.78 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp4 : -14.46 -1.61 10 1.00 [bos] ! ? ! ! ; ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-59 src: none none 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -68.10 /-1.61 /-66.49 /0.69/-0.69 -4.54 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -68.10 /-1.61 /-66.49 / /-0.69 -4.54 /-0.11 16 [bos] what the hell right did eddie have saying a thing like that ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -115.53/-12.03 /-103.51/ /-37.71 -8.25 /-0.86 15 [bos] what the hell right did eddie have saying a thing like that ? [eos] tgt3: mod/noi/dif/loss/nce/logp -172.85/-11.84 /-161.00/ /-95.21 -28.81/-1.97 7 [bos] what the hell right . [eos] tgt4: mod/noi/dif/loss/nce/logp -104.84/-12.08 /-92.76 / /-26.97 -6.99 /-0.81 16 [bos] what the hell right did eddie have saying a thing like that ? . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.39 /-12.77 /-78.63 / /-12.83 -6.09 /-0.85 16 [bos] what the hell right did eddie have saying the thing like that ? ? [eos] cls0 - sp0 : -17.10 -1.90 10 0.22 [bos] ! the ! ! ! ! ! ! [eos] cls0 - sp1 : -17.47 -1.94 10 0.22 [bos] ! the ! ! ! ! ! ! [eos] cls0 - sp2 : -17.50 -1.94 10 0.11 [bos] we the ! ! ! ! ! ! [eos] cls0 - sp3 : -17.55 -1.95 10 0.00 [bos] we the ! ! ! ! ! ! [eos] cls0 - sp4 : -17.65 -1.96 10 0.11 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp0 : -16.27 -1.81 10 0.44 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp1 : -16.72 -1.86 10 0.44 [bos] ! ! ! ! ! ! ! ! [eos] cls1 - sp2 : -16.92 -1.88 10 0.33 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp3 : -16.94 -1.88 10 0.33 [bos] ! the ! ! ! ! ! ! [eos] cls1 - sp4 : -16.95 -1.88 10 0.33 [bos] ! the ! ! ! ! ! ! [eos] cls2 - sp0 : -14.78 -1.64 10 0.67 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp1 : -15.13 -1.68 10 0.67 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp2 : -15.59 -1.73 10 0.56 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp3 : -15.97 -1.77 10 0.56 [bos] ! ! ! ! ! ! ! ! [eos] cls2 - sp4 : -16.23 -1.80 10 0.56 [bos] ! the ! ! ! ! ! ! [eos] cls3 - sp0 : -13.54 -1.50 10 1.00 [bos] ! ? ! ! ! ! ! ! [eos] cls3 - sp1 : -14.20 -1.58 10 0.89 [bos] ! ? ! ! ! ! ! ! [eos] cls3 - sp2 : -14.24 -1.58 10 0.89 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp3 : -14.35 -1.59 10 0.78 [bos] ! ! ! ! ! ! ! ! [eos] cls3 - sp4 : -14.46 -1.61 10 1.00 [bos] ! ? ! ! ; ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-60 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.28 /-1.90 /-69.38 /0.69/-0.69 -4.19 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.28 /-1.90 /-69.38 / /-0.69 -4.19 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -109.26/-12.87 /-96.38 / /-27.70 -6.83 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -94.66 /-12.98 /-81.68 / /-13.00 -5.57 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.84/-13.03 /-94.80 / /-26.12 -5.99 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -88.66 /-12.42 /-76.23 / /-7.55 -5.22 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -14.30 -2.86 6 0.20 [bos] we ! ! ! [eos] cls0 - sp1 : -23.08 -2.10 12 0.18 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp2 : -23.36 -2.12 12 0.18 [bos] ! ! ! ! ! i was be ! , [eos] cls0 - sp3 : -23.52 -2.14 12 0.09 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp4 : -27.04 -1.59 18 0.24 [bos] ! ! ! ! ! ! was couldn't ! , ! a ! ! that . [eos] cls1 - sp0 : -13.20 -2.64 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -19.48 -1.77 12 0.45 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp2 : -19.53 -1.78 12 0.36 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp3 : -19.79 -1.80 12 0.45 [bos] ! ! ! ! ! ! was be ! , [eos] cls1 - sp4 : -20.01 -1.82 12 0.27 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp0 : -18.02 -1.64 12 0.73 [bos] ! ! ! ! ! ! : ! ! , [eos] cls2 - sp1 : -18.12 -1.65 12 0.73 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp2 : -18.43 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp3 : -18.44 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp4 : -18.54 -1.69 12 0.55 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp0 : -18.27 -1.66 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp1 : -18.29 -1.66 12 1.00 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp2 : -18.44 -1.68 12 0.82 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp3 : -18.49 -1.68 12 0.82 [bos] ! ! ! ! ! ! : ! ? , [eos] cls3 - sp4 : -18.66 -1.70 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-61 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.35 /-1.90 /-70.45 /0.69/-0.69 -4.26 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.35 /-1.90 /-70.45 / /-0.69 -4.26 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.50/-12.87 /-100.63/ /-30.87 -7.09 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -95.16 /-12.98 /-82.18 / /-12.43 -5.60 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -109.58/-13.03 /-96.55 / /-26.80 -6.09 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -89.05 /-12.42 /-76.63 / /-6.87 -5.24 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -14.30 -2.86 6 0.20 [bos] we ! ! ! [eos] cls0 - sp1 : -23.08 -2.10 12 0.18 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp2 : -23.36 -2.12 12 0.18 [bos] ! ! ! ! ! i was be ! , [eos] cls0 - sp3 : -23.52 -2.14 12 0.09 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp4 : -27.04 -1.59 18 0.24 [bos] ! ! ! ! ! ! was couldn't ! , ! a ! ! that . [eos] cls1 - sp0 : -13.20 -2.64 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -19.48 -1.77 12 0.45 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp2 : -19.53 -1.78 12 0.36 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp3 : -19.79 -1.80 12 0.45 [bos] ! ! ! ! ! ! was be ! , [eos] cls1 - sp4 : -20.01 -1.82 12 0.27 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp0 : -18.02 -1.64 12 0.73 [bos] ! ! ! ! ! ! : ! ! , [eos] cls2 - sp1 : -18.12 -1.65 12 0.73 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp2 : -18.43 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp3 : -18.44 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp4 : -18.54 -1.69 12 0.55 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp0 : -18.27 -1.66 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp1 : -18.29 -1.66 12 1.00 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp2 : -18.44 -1.68 12 0.82 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp3 : -18.49 -1.68 12 0.82 [bos] ! ! ! ! ! ! : ! ? , [eos] cls3 - sp4 : -18.66 -1.70 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-62 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.80 /-1.90 /-69.90 /0.69/-0.69 -4.22 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.80 /-1.90 /-69.90 / /-0.69 -4.22 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -107.86/-12.87 /-94.99 / /-25.79 -6.74 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -94.87 /-12.98 /-81.89 / /-12.69 -5.58 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.79/-13.03 /-94.76 / /-25.55 -5.99 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -88.51 /-12.42 /-76.09 / /-6.89 -5.21 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -18.31 -1.53 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp1 : -18.56 -1.55 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp2 : -18.79 -1.57 13 0.08 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp3 : -18.81 -1.57 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp4 : -18.99 -1.58 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp0 : -17.54 -1.46 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp1 : -17.59 -1.47 13 0.33 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp2 : -17.63 -1.47 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp3 : -17.76 -1.48 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp4 : -17.78 -1.48 13 0.25 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp0 : -17.04 -1.42 13 0.58 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp1 : -17.43 -1.45 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp2 : -17.75 -1.48 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp3 : -17.97 -1.50 13 0.50 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp4 : -21.80 -1.28 18 0.71 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! that . [eos] cls3 - sp0 : -21.28 -1.25 18 1.00 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! ! . [eos] cls3 - sp1 : -21.43 -1.26 18 1.00 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp2 : -21.64 -1.27 18 0.94 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp3 : -21.83 -1.28 18 1.00 [bos] ! ! ! ! ! ! she ! ? , ! a ! ! ! . [eos] cls3 - sp4 : -21.93 -1.29 18 0.94 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! that . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-63 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.94 /-1.90 /-71.04 /0.69/-0.69 -4.29 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.94 /-1.90 /-71.04 / /-0.69 -4.29 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -112.82/-12.87 /-99.95 / /-29.61 -7.05 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -95.72 /-12.98 /-82.74 / /-12.40 -5.63 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -109.58/-13.03 /-96.55 / /-26.20 -6.09 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -89.49 /-12.42 /-77.07 / /-6.72 -5.26 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -18.31 -1.53 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp1 : -18.56 -1.55 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp2 : -18.79 -1.57 13 0.08 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp3 : -18.81 -1.57 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp4 : -18.99 -1.58 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp0 : -17.54 -1.46 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp1 : -17.59 -1.47 13 0.33 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp2 : -17.63 -1.47 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp3 : -17.76 -1.48 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp4 : -17.78 -1.48 13 0.25 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp0 : -17.04 -1.42 13 0.58 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp1 : -17.43 -1.45 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp2 : -17.75 -1.48 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp3 : -17.97 -1.50 13 0.50 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp4 : -21.80 -1.28 18 0.71 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! that . [eos] cls3 - sp0 : -21.28 -1.25 18 1.00 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! ! . [eos] cls3 - sp1 : -21.43 -1.26 18 1.00 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp2 : -21.64 -1.27 18 0.94 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp3 : -21.83 -1.28 18 1.00 [bos] ! ! ! ! ! ! she ! ? , ! a ! ! ! . [eos] cls3 - sp4 : -21.93 -1.29 18 0.94 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! that . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-64 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.28 /-1.90 /-69.38 /0.69/-0.69 -4.19 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.28 /-1.90 /-69.38 / /-0.69 -4.19 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -109.26/-12.87 /-96.38 / /-27.70 -6.83 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -94.66 /-12.98 /-81.68 / /-13.00 -5.57 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.84/-13.03 /-94.80 / /-26.12 -5.99 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -88.66 /-12.42 /-76.23 / /-7.55 -5.22 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -14.30 -2.86 6 0.20 [bos] we ! ! ! [eos] cls0 - sp1 : -23.08 -2.10 12 0.18 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp2 : -23.36 -2.12 12 0.18 [bos] ! ! ! ! ! i was be ! , [eos] cls0 - sp3 : -23.52 -2.14 12 0.09 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp4 : -27.04 -1.59 18 0.24 [bos] ! ! ! ! ! ! was couldn't ! , ! a ! ! that . [eos] cls1 - sp0 : -13.20 -2.64 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -19.48 -1.77 12 0.45 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp2 : -19.53 -1.78 12 0.36 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp3 : -19.79 -1.80 12 0.45 [bos] ! ! ! ! ! ! was be ! , [eos] cls1 - sp4 : -20.01 -1.82 12 0.27 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp0 : -18.02 -1.64 12 0.73 [bos] ! ! ! ! ! ! : ! ! , [eos] cls2 - sp1 : -18.12 -1.65 12 0.73 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp2 : -18.43 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp3 : -18.44 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp4 : -18.54 -1.69 12 0.55 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp0 : -18.27 -1.66 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp1 : -18.29 -1.66 12 1.00 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp2 : -18.44 -1.68 12 0.82 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp3 : -18.49 -1.68 12 0.82 [bos] ! ! ! ! ! ! : ! ? , [eos] cls3 - sp4 : -18.66 -1.70 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-65 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.35 /-1.90 /-70.45 /0.69/-0.69 -4.26 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.35 /-1.90 /-70.45 / /-0.69 -4.26 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.50/-12.87 /-100.63/ /-30.87 -7.09 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -95.16 /-12.98 /-82.18 / /-12.43 -5.60 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -109.58/-13.03 /-96.55 / /-26.80 -6.09 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -89.05 /-12.42 /-76.63 / /-6.87 -5.24 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -14.30 -2.86 6 0.20 [bos] we ! ! ! [eos] cls0 - sp1 : -23.08 -2.10 12 0.18 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp2 : -23.36 -2.12 12 0.18 [bos] ! ! ! ! ! i was be ! , [eos] cls0 - sp3 : -23.52 -2.14 12 0.09 [bos] ! ! ! ! ! i was first ! , [eos] cls0 - sp4 : -27.04 -1.59 18 0.24 [bos] ! ! ! ! ! ! was couldn't ! , ! a ! ! that . [eos] cls1 - sp0 : -13.20 -2.64 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -19.48 -1.77 12 0.45 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp2 : -19.53 -1.78 12 0.36 [bos] ! ! ! ! ! ! was ! ! , [eos] cls1 - sp3 : -19.79 -1.80 12 0.45 [bos] ! ! ! ! ! ! was be ! , [eos] cls1 - sp4 : -20.01 -1.82 12 0.27 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp0 : -18.02 -1.64 12 0.73 [bos] ! ! ! ! ! ! : ! ! , [eos] cls2 - sp1 : -18.12 -1.65 12 0.73 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp2 : -18.43 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp3 : -18.44 -1.68 12 0.64 [bos] ! ! ! ! ! ! was ! ! , [eos] cls2 - sp4 : -18.54 -1.69 12 0.55 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp0 : -18.27 -1.66 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp1 : -18.29 -1.66 12 1.00 [bos] ! ! ! ! ! ! : ! ! , [eos] cls3 - sp2 : -18.44 -1.68 12 0.82 [bos] ! ! ! ! ! ! was ! ! , [eos] cls3 - sp3 : -18.49 -1.68 12 0.82 [bos] ! ! ! ! ! ! : ! ? , [eos] cls3 - sp4 : -18.66 -1.70 12 0.82 [bos] ! ! ! ! ! ! : ! ! , [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-66 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.80 /-1.90 /-69.90 /0.69/-0.69 -4.22 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.80 /-1.90 /-69.90 / /-0.69 -4.22 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -107.86/-12.87 /-94.99 / /-25.79 -6.74 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -94.87 /-12.98 /-81.89 / /-12.69 -5.58 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.79/-13.03 /-94.76 / /-25.55 -5.99 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -88.51 /-12.42 /-76.09 / /-6.89 -5.21 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -18.31 -1.53 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp1 : -18.56 -1.55 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp2 : -18.79 -1.57 13 0.08 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp3 : -18.81 -1.57 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp4 : -18.99 -1.58 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp0 : -17.54 -1.46 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp1 : -17.59 -1.47 13 0.33 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp2 : -17.63 -1.47 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp3 : -17.76 -1.48 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp4 : -17.78 -1.48 13 0.25 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp0 : -17.04 -1.42 13 0.58 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp1 : -17.43 -1.45 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp2 : -17.75 -1.48 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp3 : -17.97 -1.50 13 0.50 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp4 : -21.80 -1.28 18 0.71 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! that . [eos] cls3 - sp0 : -21.28 -1.25 18 1.00 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! ! . [eos] cls3 - sp1 : -21.43 -1.26 18 1.00 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp2 : -21.64 -1.27 18 0.94 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp3 : -21.83 -1.28 18 1.00 [bos] ! ! ! ! ! ! she ! ? , ! a ! ! ! . [eos] cls3 - sp4 : -21.93 -1.29 18 0.94 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! that . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-67 src: none none 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.94 /-1.90 /-71.04 /0.69/-0.69 -4.29 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.94 /-1.90 /-71.04 / /-0.69 -4.29 /-0.11 18 [bos] he just didn't know what he was talking about , saying a thing like that . [eos] tgt2: mod/noi/dif/loss/nce/logp -112.82/-12.87 /-99.95 / /-29.61 -7.05 /-0.80 17 [bos] he just didn't know what he was talking about , saying a thing like that [eos] tgt3: mod/noi/dif/loss/nce/logp -95.72 /-12.98 /-82.74 / /-12.40 -5.63 /-0.76 18 [bos] he just didn't know what he was talking about , saying the thing like that . [eos] tgt4: mod/noi/dif/loss/nce/logp -109.58/-13.03 /-96.55 / /-26.20 -6.09 /-0.72 19 [bos] he just didn't know what he was talking about , saying a thing like that . . [eos] tgt5: mod/noi/dif/loss/nce/logp -89.49 /-12.42 /-77.07 / /-6.72 -5.26 /-0.73 18 [bos] he just didn't know what he was talking to , saying a thing like that . [eos] cls0 - sp0 : -18.31 -1.53 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp1 : -18.56 -1.55 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp2 : -18.79 -1.57 13 0.08 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp3 : -18.81 -1.57 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls0 - sp4 : -18.99 -1.58 13 0.17 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp0 : -17.54 -1.46 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp1 : -17.59 -1.47 13 0.33 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp2 : -17.63 -1.47 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp3 : -17.76 -1.48 13 0.42 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls1 - sp4 : -17.78 -1.48 13 0.25 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp0 : -17.04 -1.42 13 0.58 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp1 : -17.43 -1.45 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp2 : -17.75 -1.48 13 0.67 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp3 : -17.97 -1.50 13 0.50 [bos] ! ! ! ! ! ! was ! ! , ! [eos] cls2 - sp4 : -21.80 -1.28 18 0.71 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! that . [eos] cls3 - sp0 : -21.28 -1.25 18 1.00 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! ! . [eos] cls3 - sp1 : -21.43 -1.26 18 1.00 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp2 : -21.64 -1.27 18 0.94 [bos] ! ! ! ! ! ! was ! ! , ! a ! ! ! . [eos] cls3 - sp3 : -21.83 -1.28 18 1.00 [bos] ! ! ! ! ! ! she ! ? , ! a ! ! ! . [eos] cls3 - sp4 : -21.93 -1.29 18 0.94 [bos] ! ! ! ! ! ! she ! ! , ! a ! ! that . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-68 src: none none 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt0: mod/noi/dif/loss/nce/logp -103.50/-2.22 /-101.28/0.69/-0.69 -4.93 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt1: mod/noi/dif/loss/nce/logp -103.50/-2.22 /-101.28/ /-0.69 -4.93 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt2: mod/noi/dif/loss/nce/logp -143.93/-13.11 /-130.82/ /-30.23 -7.20 /-0.66 21 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him [eos] tgt3: mod/noi/dif/loss/nce/logp -125.19/-14.11 /-111.08/ /-10.49 -5.96 /-0.67 22 [bos] fifty broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt4: mod/noi/dif/loss/nce/logp -120.32/-12.98 /-107.34/ /-6.76 -5.73 /-0.62 22 [bos] the broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt5: mod/noi/dif/loss/nce/logp -139.10/-13.35 /-125.74/ /-25.16 -6.32 /-0.61 23 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . . [eos] cls0 - sp0 : -41.02 -1.95 22 0.00 [bos] it most couldn't were -- we that [unk] of any and the first of first cleaning to cleaning but . [eos] cls0 - sp1 : -41.06 -1.96 22 0.00 [bos] it most couldn't were -- we that [unk] of any and the first of first cleaning to receiving but . [eos] cls0 - sp2 : -41.10 -1.96 22 0.00 [bos] it most couldn't were -- we that [unk] of any and the first of first cleaning to organized but . [eos] cls0 - sp3 : -41.13 -1.96 22 0.00 [bos] it most couldn't were him we that [unk] of any and the first of first cleaning to cleaning but . [eos] cls0 - sp4 : -41.16 -1.96 22 0.00 [bos] it most couldn't were -- we that [unk] of no and the first of first cleaning to cleaning but . [eos] cls1 - sp0 : -47.95 -2.28 22 0.29 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to telephone but . [eos] cls1 - sp1 : -47.99 -2.29 22 0.29 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to discussed but . [eos] cls1 - sp2 : -53.24 -2.54 22 0.29 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to bidding but . [eos] cls1 - sp3 : -53.26 -2.54 22 0.33 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to telephone but . [eos] cls1 - sp4 : -53.35 -2.54 22 0.33 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to discussed but . [eos] cls2 - sp0 : -47.18 -2.25 22 0.67 [bos] it most 7 were -- into that [unk] of no and the personal of don't bidding to telephone but . [eos] cls2 - sp1 : -47.20 -2.25 22 0.67 [bos] it most 7 were -- into that [unk] of don't and the personal of don't bidding to telephone but . [eos] cls2 - sp2 : -47.28 -2.25 22 0.67 [bos] it most 7 were but into that [unk] of no and the personal of don't bidding to telephone but . [eos] cls2 - sp3 : -47.32 -2.25 22 0.67 [bos] it most 7 were -- into that [unk] of don't and the first of don't bidding to telephone but . [eos] cls2 - sp4 : -47.34 -2.25 22 0.67 [bos] it most 7 were but into that [unk] of don't and the personal of don't bidding to telephone but . [eos] cls3 - sp0 : -43.10 -2.05 22 0.90 [bos] it most 7 were but into when [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp1 : -43.27 -2.06 22 0.86 [bos] it most 7 were but into when [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp2 : -43.28 -2.06 22 0.90 [bos] it most 7 were but into but [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp3 : -43.29 -2.06 22 0.90 [bos] it most 7 were -- into when [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp4 : -43.31 -2.06 22 0.90 [bos] it first 7 were but into when [unk] of no and the personal of don't telephone to telephone but . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-69 src: none none 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt0: mod/noi/dif/loss/nce/logp -99.38 /-2.22 /-97.15 /0.69/-0.69 -4.73 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt1: mod/noi/dif/loss/nce/logp -99.38 /-2.22 /-97.15 / /-0.69 -4.73 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt2: mod/noi/dif/loss/nce/logp -144.92/-13.11 /-131.81/ /-35.35 -7.25 /-0.66 21 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him [eos] tgt3: mod/noi/dif/loss/nce/logp -121.40/-14.11 /-107.29/ /-10.83 -5.78 /-0.67 22 [bos] fifty broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt4: mod/noi/dif/loss/nce/logp -117.26/-12.98 /-104.29/ /-7.82 -5.58 /-0.62 22 [bos] the broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt5: mod/noi/dif/loss/nce/logp -134.38/-13.35 /-121.02/ /-24.56 -6.11 /-0.61 23 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . . [eos] cls0 - sp0 : -41.02 -1.95 22 0.00 [bos] it most couldn't were -- we that [unk] of any and the first of first cleaning to cleaning but . [eos] cls0 - sp1 : -41.06 -1.96 22 0.00 [bos] it most couldn't were -- we that [unk] of any and the first of first cleaning to receiving but . [eos] cls0 - sp2 : -41.10 -1.96 22 0.00 [bos] it most couldn't were -- we that [unk] of any and the first of first cleaning to organized but . [eos] cls0 - sp3 : -41.13 -1.96 22 0.00 [bos] it most couldn't were him we that [unk] of any and the first of first cleaning to cleaning but . [eos] cls0 - sp4 : -41.16 -1.96 22 0.00 [bos] it most couldn't were -- we that [unk] of no and the first of first cleaning to cleaning but . [eos] cls1 - sp0 : -47.95 -2.28 22 0.29 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to telephone but . [eos] cls1 - sp1 : -47.99 -2.29 22 0.29 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to discussed but . [eos] cls1 - sp2 : -53.24 -2.54 22 0.29 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to bidding but . [eos] cls1 - sp3 : -53.26 -2.54 22 0.33 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to telephone but . [eos] cls1 - sp4 : -53.35 -2.54 22 0.33 [bos] it most 7 were -- into that [unk] of couldn't and the first of first cleaning to discussed but . [eos] cls2 - sp0 : -47.18 -2.25 22 0.67 [bos] it most 7 were -- into that [unk] of no and the personal of don't bidding to telephone but . [eos] cls2 - sp1 : -47.20 -2.25 22 0.67 [bos] it most 7 were -- into that [unk] of don't and the personal of don't bidding to telephone but . [eos] cls2 - sp2 : -47.28 -2.25 22 0.67 [bos] it most 7 were but into that [unk] of no and the personal of don't bidding to telephone but . [eos] cls2 - sp3 : -47.32 -2.25 22 0.67 [bos] it most 7 were -- into that [unk] of don't and the first of don't bidding to telephone but . [eos] cls2 - sp4 : -47.34 -2.25 22 0.67 [bos] it most 7 were but into that [unk] of don't and the personal of don't bidding to telephone but . [eos] cls3 - sp0 : -43.10 -2.05 22 0.90 [bos] it most 7 were but into when [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp1 : -43.27 -2.06 22 0.86 [bos] it most 7 were but into when [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp2 : -43.28 -2.06 22 0.90 [bos] it most 7 were but into but [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp3 : -43.29 -2.06 22 0.90 [bos] it most 7 were -- into when [unk] of no and the personal of don't telephone to telephone but . [eos] cls3 - sp4 : -43.31 -2.06 22 0.90 [bos] it first 7 were but into when [unk] of no and the personal of don't telephone to telephone but . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-70 src: none none 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt0: mod/noi/dif/loss/nce/logp -108.10/-2.22 /-105.88/0.7/-0.70 -5.15 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt1: mod/noi/dif/loss/nce/logp -108.10/-2.22 /-105.88/ /-0.70 -5.15 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt2: mod/noi/dif/loss/nce/logp -145.65/-13.11 /-132.54/ /-27.36 -7.28 /-0.66 21 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him [eos] tgt3: mod/noi/dif/loss/nce/logp -128.50/-14.11 /-114.39/ /-9.21 -6.12 /-0.67 22 [bos] fifty broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt4: mod/noi/dif/loss/nce/logp -123.45/-12.98 /-110.47/ /-5.30 -5.88 /-0.62 22 [bos] the broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt5: mod/noi/dif/loss/nce/logp -142.55/-13.35 /-129.20/ /-24.02 -6.48 /-0.61 23 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . . [eos] cls0 - sp0 : -45.81 -2.18 22 0.00 [bos] it streets streets its but into when [unk] of joined and the first of couldn't organized to organized but . [eos] cls0 - sp1 : -45.87 -2.18 22 0.00 [bos] it streets streets its but into all [unk] of joined and the first of couldn't organized to organized but . [eos] cls0 - sp2 : -45.91 -2.19 22 0.00 [bos] it streets streets its but into when [unk] of joined and the first of streets organized to organized but . [eos] cls0 - sp3 : -45.92 -2.19 22 0.00 [bos] it streets streets its but into when [unk] of joined and the first of couldn't organized to joined but . [eos] cls0 - sp4 : -45.92 -2.19 22 0.00 [bos] it streets later its but into when [unk] of joined and the first of couldn't organized to organized but . [eos] cls1 - sp0 : -48.70 -2.32 22 0.29 [bos] it streets 7 about but into when [unk] of telephone and the first of couldn't organized to bidding but . [eos] cls1 - sp1 : -48.82 -2.32 22 0.29 [bos] it streets 7 about but into thought [unk] of telephone and the first of couldn't organized to bidding but . [eos] cls1 - sp2 : -48.86 -2.33 22 0.29 [bos] it streets 7 about but into when [unk] of telephone and the first of couldn't pain to bidding but . [eos] cls1 - sp3 : -48.87 -2.33 22 0.29 [bos] it streets 7 about but into when [unk] of telephone and the joined of couldn't organized to bidding but . [eos] cls1 - sp4 : -48.95 -2.33 22 0.29 [bos] it streets 7 life but into when [unk] of telephone and the first of couldn't organized to bidding but . [eos] cls2 - sp0 : -48.78 -2.32 22 0.52 [bos] it streets 7 about but into when [unk] of telephone and the first of don't telephone to telephone but . [eos] cls2 - sp1 : -49.14 -2.34 22 0.57 [bos] it streets 7 about but into when [unk] of telephone and the first of don't telephone to telephone but . [eos] cls2 - sp2 : -49.22 -2.34 22 0.52 [bos] it streets 7 about but into thought [unk] of telephone and the first of don't telephone to telephone but . [eos] cls2 - sp3 : -49.50 -2.36 22 0.67 [bos] it streets 7 ! but into when [unk] of telephone and the telephone of corner telephone to telephone but . [eos] cls2 - sp4 : -49.50 -2.36 22 0.67 [bos] it streets 7 ! but into when [unk] of telephone and the telephone of don't telephone to telephone but . [eos] cls3 - sp0 : -44.75 -2.13 22 1.00 [bos] it agree personal life but into thought [unk] of telephone and the made of corner telephone to telephone but . [eos] cls3 - sp1 : -44.81 -2.13 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the made of don't telephone to telephone but . [eos] cls3 - sp2 : -44.88 -2.14 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the made of personal telephone to telephone but . [eos] cls3 - sp3 : -44.92 -2.14 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the first of don't telephone to telephone but . [eos] cls3 - sp4 : -45.07 -2.15 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the telephone of don't telephone to telephone but . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-71 src: none none 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt0: mod/noi/dif/loss/nce/logp -101.95/-2.22 /-99.73 /0.69/-0.69 -4.85 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt1: mod/noi/dif/loss/nce/logp -101.95/-2.22 /-99.73 / /-0.69 -4.85 /-0.11 22 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt2: mod/noi/dif/loss/nce/logp -144.04/-13.11 /-130.93/ /-31.90 -7.20 /-0.66 21 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him [eos] tgt3: mod/noi/dif/loss/nce/logp -122.16/-14.11 /-108.05/ /-9.01 -5.82 /-0.67 22 [bos] fifty broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt4: mod/noi/dif/loss/nce/logp -118.49/-12.98 /-105.52/ /-6.48 -5.64 /-0.62 22 [bos] the broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . [eos] tgt5: mod/noi/dif/loss/nce/logp -136.65/-13.35 /-123.29/ /-24.26 -6.21 /-0.61 23 [bos] his broad reading took him into certain [unk] of religion and the subject of religion began to fascinate him . . [eos] cls0 - sp0 : -45.81 -2.18 22 0.00 [bos] it streets streets its but into when [unk] of joined and the first of couldn't organized to organized but . [eos] cls0 - sp1 : -45.87 -2.18 22 0.00 [bos] it streets streets its but into all [unk] of joined and the first of couldn't organized to organized but . [eos] cls0 - sp2 : -45.91 -2.19 22 0.00 [bos] it streets streets its but into when [unk] of joined and the first of streets organized to organized but . [eos] cls0 - sp3 : -45.92 -2.19 22 0.00 [bos] it streets streets its but into when [unk] of joined and the first of couldn't organized to joined but . [eos] cls0 - sp4 : -45.92 -2.19 22 0.00 [bos] it streets later its but into when [unk] of joined and the first of couldn't organized to organized but . [eos] cls1 - sp0 : -48.70 -2.32 22 0.29 [bos] it streets 7 about but into when [unk] of telephone and the first of couldn't organized to bidding but . [eos] cls1 - sp1 : -48.82 -2.32 22 0.29 [bos] it streets 7 about but into thought [unk] of telephone and the first of couldn't organized to bidding but . [eos] cls1 - sp2 : -48.86 -2.33 22 0.29 [bos] it streets 7 about but into when [unk] of telephone and the first of couldn't pain to bidding but . [eos] cls1 - sp3 : -48.87 -2.33 22 0.29 [bos] it streets 7 about but into when [unk] of telephone and the joined of couldn't organized to bidding but . [eos] cls1 - sp4 : -48.95 -2.33 22 0.29 [bos] it streets 7 life but into when [unk] of telephone and the first of couldn't organized to bidding but . [eos] cls2 - sp0 : -48.78 -2.32 22 0.52 [bos] it streets 7 about but into when [unk] of telephone and the first of don't telephone to telephone but . [eos] cls2 - sp1 : -49.14 -2.34 22 0.57 [bos] it streets 7 about but into when [unk] of telephone and the first of don't telephone to telephone but . [eos] cls2 - sp2 : -49.22 -2.34 22 0.52 [bos] it streets 7 about but into thought [unk] of telephone and the first of don't telephone to telephone but . [eos] cls2 - sp3 : -49.50 -2.36 22 0.67 [bos] it streets 7 ! but into when [unk] of telephone and the telephone of corner telephone to telephone but . [eos] cls2 - sp4 : -49.50 -2.36 22 0.67 [bos] it streets 7 ! but into when [unk] of telephone and the telephone of don't telephone to telephone but . [eos] cls3 - sp0 : -44.75 -2.13 22 1.00 [bos] it agree personal life but into thought [unk] of telephone and the made of corner telephone to telephone but . [eos] cls3 - sp1 : -44.81 -2.13 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the made of don't telephone to telephone but . [eos] cls3 - sp2 : -44.88 -2.14 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the made of personal telephone to telephone but . [eos] cls3 - sp3 : -44.92 -2.14 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the first of don't telephone to telephone but . [eos] cls3 - sp4 : -45.07 -2.15 22 1.00 [bos] it agree personal life but into thought [unk] of corner and the telephone of don't telephone to telephone but . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-72 src: none none 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt0: mod/noi/dif/loss/nce/logp -132.47/-2.59 /-129.88/0.69/-0.69 -5.10 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt1: mod/noi/dif/loss/nce/logp -132.47/-2.59 /-129.88/ /-0.69 -5.10 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt2: mod/noi/dif/loss/nce/logp -173.35/-13.43 /-159.92/ /-30.73 -6.93 /-0.54 26 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water [eos] tgt3: mod/noi/dif/loss/nce/logp -159.40/-14.48 /-144.92/ /-15.73 -6.13 /-0.56 27 [bos] he stole from fifty cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt4: mod/noi/dif/loss/nce/logp -157.57/-13.62 /-143.95/ /-14.76 -6.06 /-0.52 27 [bos] he stole from his cabin late that night and crept out into the [unk] north pacific wind and dropped the biwa into the water . [eos] tgt5: mod/noi/dif/loss/nce/logp -153.11/-13.39 /-139.72/ /-10.53 -5.89 /-0.52 27 [bos] he stole from the cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] cls0 - sp0 : -58.34 -2.24 27 0.00 [bos] i most has a cleaning later that any and joined out into a [unk] united made cleaning and other the cleaning into the this . [eos] cls0 - sp1 : -58.38 -2.25 27 0.00 [bos] i most has a cleaning joined that any and joined out into a [unk] united made cleaning and other the cleaning into the this . [eos] cls0 - sp2 : -58.50 -2.25 27 0.00 [bos] i most has a cleaning later that any and joined out into a [unk] united made cleaning and other the cleaning into the when . [eos] cls0 - sp3 : -58.55 -2.25 27 0.00 [bos] i most has a cleaning joined that any and joined out into a [unk] united made cleaning and other the cleaning into the when . [eos] cls0 - sp4 : -58.58 -2.25 27 0.00 [bos] i most has a cleaning joined that any and joined out into a [unk] united made landed and other the cleaning into the this . [eos] cls1 - sp0 : -60.79 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and so the cleaning into the when . [eos] cls1 - sp1 : -60.82 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and other the cleaning into the when . [eos] cls1 - sp2 : -60.93 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and so the cleaning into the this . [eos] cls1 - sp3 : -60.94 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and other the cleaning into the this . [eos] cls1 - sp4 : -61.00 -2.35 27 0.27 [bos] when couldn't has a telephone later that ( and telephone out into a [unk] couldn't made bidding and so the cleaning into the when . [eos] cls2 - sp0 : -62.38 -2.40 27 0.73 [bos] we most has a telephone later that any and telephone out into a [unk] don't made crime and state the crime into the ! . [eos] cls2 - sp1 : -62.39 -2.40 27 0.69 [bos] we most has a telephone later that any and telephone out into a [unk] don't made crime and state the crime into the when . [eos] cls2 - sp2 : -62.44 -2.40 27 0.69 [bos] we most has a telephone later that any and telephone out into a [unk] later made crime and state the crime into the when . [eos] cls2 - sp3 : -62.45 -2.40 27 0.73 [bos] we most has a telephone later that any and telephone out into a [unk] later made crime and state the crime into the ! . [eos] cls2 - sp4 : -62.54 -2.41 27 0.73 [bos] we most has a telephone later that any and telephone out into a [unk] later made mississippi and state the crime into the ! . [eos] cls3 - sp0 : -58.61 -2.25 27 1.00 [bos] when don't from a telephone later that personal and streets life on a [unk] personal people crime and state the crime into the this . [eos] cls3 - sp1 : -58.61 -2.25 27 1.00 [bos] when don't from a telephone later that personal and streets life on a [unk] later people crime and state the crime into the this . [eos] cls3 - sp2 : -58.71 -2.26 27 1.00 [bos] when don't from a telephone later that personal and telephone life on a [unk] personal people crime and state the crime into the this . [eos] cls3 - sp3 : -58.72 -2.26 27 1.00 [bos] when don't from a telephone later that personal and telephone life on a [unk] later people crime and state the crime into the this . [eos] cls3 - sp4 : -58.72 -2.26 27 1.00 [bos] when don't from a telephone later that personal and streets life on a [unk] personal people crime and state the crime into the when . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-73 src: none none 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt0: mod/noi/dif/loss/nce/logp -135.35/-2.59 /-132.76/0.69/-0.69 -5.21 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt1: mod/noi/dif/loss/nce/logp -135.35/-2.59 /-132.76/ /-0.69 -5.21 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt2: mod/noi/dif/loss/nce/logp -182.62/-13.43 /-169.19/ /-37.12 -7.30 /-0.54 26 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water [eos] tgt3: mod/noi/dif/loss/nce/logp -162.10/-14.48 /-147.61/ /-15.55 -6.23 /-0.56 27 [bos] he stole from fifty cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt4: mod/noi/dif/loss/nce/logp -159.62/-13.62 /-145.99/ /-13.93 -6.14 /-0.52 27 [bos] he stole from his cabin late that night and crept out into the [unk] north pacific wind and dropped the biwa into the water . [eos] tgt5: mod/noi/dif/loss/nce/logp -155.63/-13.39 /-142.23/ /-10.17 -5.99 /-0.52 27 [bos] he stole from the cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] cls0 - sp0 : -58.34 -2.24 27 0.00 [bos] i most has a cleaning later that any and joined out into a [unk] united made cleaning and other the cleaning into the this . [eos] cls0 - sp1 : -58.38 -2.25 27 0.00 [bos] i most has a cleaning joined that any and joined out into a [unk] united made cleaning and other the cleaning into the this . [eos] cls0 - sp2 : -58.50 -2.25 27 0.00 [bos] i most has a cleaning later that any and joined out into a [unk] united made cleaning and other the cleaning into the when . [eos] cls0 - sp3 : -58.55 -2.25 27 0.00 [bos] i most has a cleaning joined that any and joined out into a [unk] united made cleaning and other the cleaning into the when . [eos] cls0 - sp4 : -58.58 -2.25 27 0.00 [bos] i most has a cleaning joined that any and joined out into a [unk] united made landed and other the cleaning into the this . [eos] cls1 - sp0 : -60.79 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and so the cleaning into the when . [eos] cls1 - sp1 : -60.82 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and other the cleaning into the when . [eos] cls1 - sp2 : -60.93 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and so the cleaning into the this . [eos] cls1 - sp3 : -60.94 -2.34 27 0.27 [bos] when couldn't has a telephone don't that ( and telephone out into a [unk] couldn't made bidding and other the cleaning into the this . [eos] cls1 - sp4 : -61.00 -2.35 27 0.27 [bos] when couldn't has a telephone later that ( and telephone out into a [unk] couldn't made bidding and so the cleaning into the when . [eos] cls2 - sp0 : -62.38 -2.40 27 0.73 [bos] we most has a telephone later that any and telephone out into a [unk] don't made crime and state the crime into the ! . [eos] cls2 - sp1 : -62.39 -2.40 27 0.69 [bos] we most has a telephone later that any and telephone out into a [unk] don't made crime and state the crime into the when . [eos] cls2 - sp2 : -62.44 -2.40 27 0.69 [bos] we most has a telephone later that any and telephone out into a [unk] later made crime and state the crime into the when . [eos] cls2 - sp3 : -62.45 -2.40 27 0.73 [bos] we most has a telephone later that any and telephone out into a [unk] later made crime and state the crime into the ! . [eos] cls2 - sp4 : -62.54 -2.41 27 0.73 [bos] we most has a telephone later that any and telephone out into a [unk] later made mississippi and state the crime into the ! . [eos] cls3 - sp0 : -58.61 -2.25 27 1.00 [bos] when don't from a telephone later that personal and streets life on a [unk] personal people crime and state the crime into the this . [eos] cls3 - sp1 : -58.61 -2.25 27 1.00 [bos] when don't from a telephone later that personal and streets life on a [unk] later people crime and state the crime into the this . [eos] cls3 - sp2 : -58.71 -2.26 27 1.00 [bos] when don't from a telephone later that personal and telephone life on a [unk] personal people crime and state the crime into the this . [eos] cls3 - sp3 : -58.72 -2.26 27 1.00 [bos] when don't from a telephone later that personal and telephone life on a [unk] later people crime and state the crime into the this . [eos] cls3 - sp4 : -58.72 -2.26 27 1.00 [bos] when don't from a telephone later that personal and streets life on a [unk] personal people crime and state the crime into the when . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-74 src: none none 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt0: mod/noi/dif/loss/nce/logp -134.40/-2.59 /-131.81/0.69/-0.69 -5.17 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt1: mod/noi/dif/loss/nce/logp -134.40/-2.59 /-131.81/ /-0.69 -5.17 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt2: mod/noi/dif/loss/nce/logp -175.27/-13.43 /-161.84/ /-30.72 -7.01 /-0.54 26 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water [eos] tgt3: mod/noi/dif/loss/nce/logp -161.16/-14.48 /-146.68/ /-15.56 -6.20 /-0.56 27 [bos] he stole from fifty cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt4: mod/noi/dif/loss/nce/logp -160.00/-13.62 /-146.37/ /-15.26 -6.15 /-0.52 27 [bos] he stole from his cabin late that night and crept out into the [unk] north pacific wind and dropped the biwa into the water . [eos] tgt5: mod/noi/dif/loss/nce/logp -154.49/-13.39 /-141.10/ /-9.98 -5.94 /-0.52 27 [bos] he stole from the cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] cls0 - sp0 : -55.55 -2.14 27 0.00 [bos] she most has a streets any that joined and joined ) into a [unk] first first cleaning and expecting the joined into the ! . [eos] cls0 - sp1 : -55.55 -2.14 27 0.00 [bos] she most has a streets any that joined and streets ) into a [unk] first first cleaning and expecting the joined into the ! . [eos] cls0 - sp2 : -55.64 -2.14 27 0.00 [bos] she most has a streets any that joined and joined ) into a [unk] first first cleaning and expecting the joined into the this . [eos] cls0 - sp3 : -55.65 -2.14 27 0.00 [bos] she most has a streets any that joined and streets ) into a [unk] first first cleaning and expecting the joined into the this . [eos] cls0 - sp4 : -55.65 -2.14 27 0.00 [bos] she most has a streets any that joined and united ) into a [unk] first first cleaning and expecting the joined into the ! . [eos] cls1 - sp0 : -71.12 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and streets ) into a [unk] couldn't first cleaning and expecting the discussed into the ! . [eos] cls1 - sp1 : -71.16 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and joined ) into a [unk] couldn't first cleaning and expecting the discussed into the ! . [eos] cls1 - sp2 : -71.18 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and streets ) into a [unk] couldn't first cleaning and expecting the nick into the ! . [eos] cls1 - sp3 : -71.23 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and joined ) into a [unk] couldn't first cleaning and expecting the nick into the ! . [eos] cls1 - sp4 : -71.23 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and streets ) into a [unk] couldn't first cleaning and expecting the lolotte into the ! . [eos] cls2 - sp0 : -62.46 -2.40 27 0.69 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't she telephone and streets the crime into the ! . [eos] cls2 - sp1 : -62.69 -2.41 27 0.69 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't couldn't telephone and streets the crime into the ! . [eos] cls2 - sp2 : -62.82 -2.42 27 0.73 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't she telephone and streets the crime into the ! . [eos] cls2 - sp3 : -62.97 -2.42 27 0.73 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't couldn't telephone and streets the crime into the ! . [eos] cls2 - sp4 : -63.17 -2.43 27 0.69 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't she telephone and streets the discussed into the ! . [eos] cls3 - sp0 : -57.74 -2.22 27 1.00 [bos] she personal from a corner later that personal and personal ) into a [unk] be all sponsored and streets the crime into the this . [eos] cls3 - sp1 : -57.88 -2.23 27 1.00 [bos] she personal from a corner later that personal and personal ) into a [unk] be all thought and streets the crime into the this . [eos] cls3 - sp2 : -57.89 -2.23 27 1.00 [bos] she personal from a telephone later that personal and personal ) into a [unk] be all sponsored and streets the crime into the this . [eos] cls3 - sp3 : -57.90 -2.23 27 1.00 [bos] she personal from a corner later that personal and personal space into a [unk] don't all crime and streets the crime into the this . [eos] cls3 - sp4 : -57.90 -2.23 27 1.00 [bos] she personal from a corner later that personal and personal ) into a [unk] don't all sponsored and streets the crime into the this . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-75 src: none none 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt0: mod/noi/dif/loss/nce/logp -137.61/-2.59 /-135.02/0.69/-0.69 -5.29 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt1: mod/noi/dif/loss/nce/logp -137.61/-2.59 /-135.02/ /-0.69 -5.29 /-0.10 27 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt2: mod/noi/dif/loss/nce/logp -184.51/-13.43 /-171.07/ /-36.74 -7.38 /-0.54 26 [bos] he stole from his cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water [eos] tgt3: mod/noi/dif/loss/nce/logp -164.11/-14.48 /-149.63/ /-15.30 -6.31 /-0.56 27 [bos] he stole from fifty cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] tgt4: mod/noi/dif/loss/nce/logp -162.53/-13.62 /-148.91/ /-14.58 -6.25 /-0.52 27 [bos] he stole from his cabin late that night and crept out into the [unk] north pacific wind and dropped the biwa into the water . [eos] tgt5: mod/noi/dif/loss/nce/logp -157.33/-13.39 /-143.93/ /-9.60 -6.05 /-0.52 27 [bos] he stole from the cabin late that night and crept out into a [unk] north pacific wind and dropped the biwa into the water . [eos] cls0 - sp0 : -55.55 -2.14 27 0.00 [bos] she most has a streets any that joined and joined ) into a [unk] first first cleaning and expecting the joined into the ! . [eos] cls0 - sp1 : -55.55 -2.14 27 0.00 [bos] she most has a streets any that joined and streets ) into a [unk] first first cleaning and expecting the joined into the ! . [eos] cls0 - sp2 : -55.64 -2.14 27 0.00 [bos] she most has a streets any that joined and joined ) into a [unk] first first cleaning and expecting the joined into the this . [eos] cls0 - sp3 : -55.65 -2.14 27 0.00 [bos] she most has a streets any that joined and streets ) into a [unk] first first cleaning and expecting the joined into the this . [eos] cls0 - sp4 : -55.65 -2.14 27 0.00 [bos] she most has a streets any that joined and united ) into a [unk] first first cleaning and expecting the joined into the ! . [eos] cls1 - sp0 : -71.12 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and streets ) into a [unk] couldn't first cleaning and expecting the discussed into the ! . [eos] cls1 - sp1 : -71.16 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and joined ) into a [unk] couldn't first cleaning and expecting the discussed into the ! . [eos] cls1 - sp2 : -71.18 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and streets ) into a [unk] couldn't first cleaning and expecting the nick into the ! . [eos] cls1 - sp3 : -71.23 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and joined ) into a [unk] couldn't first cleaning and expecting the nick into the ! . [eos] cls1 - sp4 : -71.23 -2.74 27 0.27 [bos] she most has a telephone later that couldn't and streets ) into a [unk] couldn't first cleaning and expecting the lolotte into the ! . [eos] cls2 - sp0 : -62.46 -2.40 27 0.69 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't she telephone and streets the crime into the ! . [eos] cls2 - sp1 : -62.69 -2.41 27 0.69 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't couldn't telephone and streets the crime into the ! . [eos] cls2 - sp2 : -62.82 -2.42 27 0.73 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't she telephone and streets the crime into the ! . [eos] cls2 - sp3 : -62.97 -2.42 27 0.73 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't couldn't telephone and streets the crime into the ! . [eos] cls2 - sp4 : -63.17 -2.43 27 0.69 [bos] she most has a telephone later that 7 and personal ) into a [unk] couldn't she telephone and streets the discussed into the ! . [eos] cls3 - sp0 : -57.74 -2.22 27 1.00 [bos] she personal from a corner later that personal and personal ) into a [unk] be all sponsored and streets the crime into the this . [eos] cls3 - sp1 : -57.88 -2.23 27 1.00 [bos] she personal from a corner later that personal and personal ) into a [unk] be all thought and streets the crime into the this . [eos] cls3 - sp2 : -57.89 -2.23 27 1.00 [bos] she personal from a telephone later that personal and personal ) into a [unk] be all sponsored and streets the crime into the this . [eos] cls3 - sp3 : -57.90 -2.23 27 1.00 [bos] she personal from a corner later that personal and personal space into a [unk] don't all crime and streets the crime into the this . [eos] cls3 - sp4 : -57.90 -2.23 27 1.00 [bos] she personal from a corner later that personal and personal ) into a [unk] don't all sponsored and streets the crime into the this . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-76 src: none none 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt0: mod/noi/dif/loss/nce/logp -55.83 /-1.26 /-54.58 /0.69/-0.69 -4.65 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt1: mod/noi/dif/loss/nce/logp -55.83 /-1.26 /-54.58 / /-0.69 -4.65 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt2: mod/noi/dif/loss/nce/logp -236.28/-11.76 /-224.52/ /-170.64 -33.75/-1.68 8 [bos] `` i've heard about it . [eos] tgt3: mod/noi/dif/loss/nce/logp -144.78/-12.32 /-132.45/ /-78.57 -18.10/-1.54 9 [bos] `` i've heard about it '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -196.17/-12.13 /-184.04/ /-130.15 -32.69/-2.02 7 [bos] `` i've heard about it [eos] tgt5: mod/noi/dif/loss/nce/logp -84.20 /-12.23 /-71.97 / /-18.09 -7.65 /-1.11 12 [bos] `` i've heard about it '' , samuel burns said [eos] cls0 - sp0 : -24.86 -2.76 10 0.11 [bos] when joined joined about it '' , joined [eos] cls0 - sp1 : -25.00 -2.78 10 0.11 [bos] `` she pain about it '' , joined [eos] cls0 - sp2 : -26.65 -2.22 13 0.00 [bos] `` she joined about it '' , no patience had . [eos] cls0 - sp3 : -26.71 -2.23 13 0.00 [bos] `` she joined about it '' , no cleaning had . [eos] cls0 - sp4 : -26.79 -2.23 13 0.00 [bos] `` she joined about it '' , no patience or . [eos] cls1 - sp0 : -25.53 -2.84 10 0.33 [bos] when corner couldn't about it '' , 7 [eos] cls1 - sp1 : -25.75 -2.86 10 0.33 [bos] `` don't telephone about it '' , joined [eos] cls1 - sp2 : -26.26 -2.92 10 0.44 [bos] `` joined 7 about it '' , joined [eos] cls1 - sp3 : -26.96 -3.00 10 0.33 [bos] when corner couldn't about it '' , joined [eos] cls1 - sp4 : -27.29 -3.03 10 0.33 [bos] when corner pain about it '' , joined [eos] cls2 - sp0 : -24.32 -2.70 10 0.56 [bos] `` she telephone about it '' , 7 [eos] cls2 - sp1 : -25.78 -2.86 10 0.56 [bos] `` she telephone about it '' , don't [eos] cls2 - sp2 : -25.85 -2.87 10 0.56 [bos] `` she telephone about it '' , 7 [eos] cls2 - sp3 : -27.43 -3.05 10 0.56 [bos] `` she telephone about it '' , couldn't [eos] cls2 - sp4 : -27.57 -3.06 10 0.56 [bos] `` she telephone about it '' , don't [eos] cls3 - sp0 : -27.02 -2.25 13 1.00 [bos] when telephone mississippi about it '' , corner mississippi or . [eos] cls3 - sp1 : -27.18 -2.27 13 1.00 [bos] when telephone telephone about it '' , corner mississippi or . [eos] cls3 - sp2 : -27.21 -2.27 13 1.00 [bos] when telephone mississippi about it '' , corner flung or . [eos] cls3 - sp3 : -27.28 -2.27 13 1.00 [bos] when telephone telephone about it '' , corner flung or . [eos] cls3 - sp4 : -27.32 -2.28 13 1.00 [bos] when telephone mississippi about it '' , corner telephone or . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-77 src: none none 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt0: mod/noi/dif/loss/nce/logp -56.66 /-1.26 /-55.40 /0.69/-0.69 -4.72 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt1: mod/noi/dif/loss/nce/logp -56.66 /-1.26 /-55.40 / /-0.69 -4.72 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt2: mod/noi/dif/loss/nce/logp -229.61/-11.76 /-217.85/ /-163.15 -32.80/-1.68 8 [bos] `` i've heard about it . [eos] tgt3: mod/noi/dif/loss/nce/logp -148.50/-12.32 /-136.17/ /-81.47 -18.56/-1.54 9 [bos] `` i've heard about it '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -194.41/-12.13 /-182.28/ /-127.58 -32.40/-2.02 7 [bos] `` i've heard about it [eos] tgt5: mod/noi/dif/loss/nce/logp -86.50 /-12.23 /-74.27 / /-19.56 -7.86 /-1.11 12 [bos] `` i've heard about it '' , samuel burns said [eos] cls0 - sp0 : -24.86 -2.76 10 0.11 [bos] when joined joined about it '' , joined [eos] cls0 - sp1 : -25.00 -2.78 10 0.11 [bos] `` she pain about it '' , joined [eos] cls0 - sp2 : -26.65 -2.22 13 0.00 [bos] `` she joined about it '' , no patience had . [eos] cls0 - sp3 : -26.71 -2.23 13 0.00 [bos] `` she joined about it '' , no cleaning had . [eos] cls0 - sp4 : -26.79 -2.23 13 0.00 [bos] `` she joined about it '' , no patience or . [eos] cls1 - sp0 : -25.53 -2.84 10 0.33 [bos] when corner couldn't about it '' , 7 [eos] cls1 - sp1 : -25.75 -2.86 10 0.33 [bos] `` don't telephone about it '' , joined [eos] cls1 - sp2 : -26.26 -2.92 10 0.44 [bos] `` joined 7 about it '' , joined [eos] cls1 - sp3 : -26.96 -3.00 10 0.33 [bos] when corner couldn't about it '' , joined [eos] cls1 - sp4 : -27.29 -3.03 10 0.33 [bos] when corner pain about it '' , joined [eos] cls2 - sp0 : -24.32 -2.70 10 0.56 [bos] `` she telephone about it '' , 7 [eos] cls2 - sp1 : -25.78 -2.86 10 0.56 [bos] `` she telephone about it '' , don't [eos] cls2 - sp2 : -25.85 -2.87 10 0.56 [bos] `` she telephone about it '' , 7 [eos] cls2 - sp3 : -27.43 -3.05 10 0.56 [bos] `` she telephone about it '' , couldn't [eos] cls2 - sp4 : -27.57 -3.06 10 0.56 [bos] `` she telephone about it '' , don't [eos] cls3 - sp0 : -27.02 -2.25 13 1.00 [bos] when telephone mississippi about it '' , corner mississippi or . [eos] cls3 - sp1 : -27.18 -2.27 13 1.00 [bos] when telephone telephone about it '' , corner mississippi or . [eos] cls3 - sp2 : -27.21 -2.27 13 1.00 [bos] when telephone mississippi about it '' , corner flung or . [eos] cls3 - sp3 : -27.28 -2.27 13 1.00 [bos] when telephone telephone about it '' , corner flung or . [eos] cls3 - sp4 : -27.32 -2.28 13 1.00 [bos] when telephone mississippi about it '' , corner telephone or . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-78 src: none none 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt0: mod/noi/dif/loss/nce/logp -56.12 /-1.26 /-54.86 /0.69/-0.69 -4.68 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt1: mod/noi/dif/loss/nce/logp -56.12 /-1.26 /-54.86 / /-0.69 -4.68 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt2: mod/noi/dif/loss/nce/logp -214.46/-11.76 /-202.70/ /-148.53 -30.64/-1.68 8 [bos] `` i've heard about it . [eos] tgt3: mod/noi/dif/loss/nce/logp -144.63/-12.32 /-132.30/ /-78.14 -18.08/-1.54 9 [bos] `` i've heard about it '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -193.59/-12.13 /-181.46/ /-127.29 -32.26/-2.02 7 [bos] `` i've heard about it [eos] tgt5: mod/noi/dif/loss/nce/logp -84.91 /-12.23 /-72.69 / /-18.52 -7.72 /-1.11 12 [bos] `` i've heard about it '' , samuel burns said [eos] cls0 - sp0 : -11.30 -2.26 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.73 -2.35 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -21.55 -2.39 10 0.11 [bos] when couldn't couldn't about it '' , no [eos] cls0 - sp3 : -21.78 -2.42 10 0.11 [bos] '' couldn't later about it '' , no [eos] cls0 - sp4 : -23.56 -1.96 13 0.00 [bos] when couldn't later about it '' , no expecting or . [eos] cls1 - sp0 : -11.01 -2.20 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.67 -2.33 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.85 -2.37 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -12.11 -2.42 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -12.20 -2.44 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -10.93 -2.19 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -11.58 -2.32 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.73 -2.35 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -12.04 -2.41 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -12.06 -2.41 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -11.03 -2.21 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -11.17 -2.23 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -11.37 -2.27 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp3 : -12.23 -2.45 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -20.48 -2.28 10 0.89 [bos] ! ! ! about it '' , don't [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-79 src: none none 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt0: mod/noi/dif/loss/nce/logp -55.30 /-1.26 /-54.04 /0.69/-0.69 -4.61 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt1: mod/noi/dif/loss/nce/logp -55.30 /-1.26 /-54.04 / /-0.69 -4.61 /-0.10 13 [bos] `` i've heard about it '' , samuel burns said . [eos] tgt2: mod/noi/dif/loss/nce/logp -223.75/-11.76 /-211.99/ /-158.64 -31.96/-1.68 8 [bos] `` i've heard about it . [eos] tgt3: mod/noi/dif/loss/nce/logp -150.43/-12.32 /-138.11/ /-84.76 -18.80/-1.54 9 [bos] `` i've heard about it '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -190.41/-12.13 /-178.28/ /-124.93 -31.74/-2.02 7 [bos] `` i've heard about it [eos] tgt5: mod/noi/dif/loss/nce/logp -86.26 /-12.23 /-74.03 / /-20.68 -7.84 /-1.11 12 [bos] `` i've heard about it '' , samuel burns said [eos] cls0 - sp0 : -11.30 -2.26 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.73 -2.35 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -21.55 -2.39 10 0.11 [bos] when couldn't couldn't about it '' , no [eos] cls0 - sp3 : -21.78 -2.42 10 0.11 [bos] '' couldn't later about it '' , no [eos] cls0 - sp4 : -23.56 -1.96 13 0.00 [bos] when couldn't later about it '' , no expecting or . [eos] cls1 - sp0 : -11.01 -2.20 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.67 -2.33 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.85 -2.37 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -12.11 -2.42 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -12.20 -2.44 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -10.93 -2.19 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -11.58 -2.32 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.73 -2.35 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -12.04 -2.41 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -12.06 -2.41 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -11.03 -2.21 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -11.17 -2.23 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -11.37 -2.27 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp3 : -12.23 -2.45 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -20.48 -2.28 10 0.89 [bos] ! ! ! about it '' , don't [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-80 src: none none 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt0: mod/noi/dif/loss/nce/logp -135.97/-2.09 /-133.88/0.75/-0.75 -6.18 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt1: mod/noi/dif/loss/nce/logp -135.97/-2.09 /-133.88/ /-0.75 -6.18 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt2: mod/noi/dif/loss/nce/logp -176.22/-13.06 /-163.16/ /-30.03 -8.39 /-0.62 22 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently [eos] tgt3: mod/noi/dif/loss/nce/logp -298.63/-12.18 /-286.45/ /-153.32 -42.66/-1.74 8 [bos] then the flames were gone . [eos] tgt4: mod/noi/dif/loss/nce/logp -149.49/-13.44 /-136.05/ /-2.92 -6.79 /-0.61 23 [bos] then the flames were gone , the stillness fell upon the severe photochemical face and richard began to tremble violently . [eos] tgt5: mod/noi/dif/loss/nce/logp -172.43/-13.22 /-159.21/ /-26.08 -7.50 /-0.57 24 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . . [eos] cls0 - sp0 : -53.99 -2.45 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined deck to cleaning joined . [eos] cls0 - sp1 : -54.01 -2.46 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined deck to cleaning be . [eos] cls0 - sp2 : -54.02 -2.46 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined cleaning to cleaning joined . [eos] cls0 - sp3 : -54.97 -2.50 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined cleaning to streets . ! [eos] cls0 - sp4 : -54.98 -2.50 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined deck to streets . ! [eos] cls1 - sp0 : -57.24 -2.60 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined deck to editor . is [eos] cls1 - sp1 : -57.26 -2.60 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined cleaning to editor . is [eos] cls1 - sp2 : -57.42 -2.61 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined patience to editor . is [eos] cls1 - sp3 : -57.64 -2.62 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined deck to streets . ! [eos] cls1 - sp4 : -57.88 -2.63 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined deck to cleaning . is [eos] cls2 - sp0 : -64.52 -2.93 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to corner she . [eos] cls2 - sp1 : -65.12 -2.96 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to telephone she . [eos] cls2 - sp2 : -65.16 -2.96 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to corner thousand . [eos] cls2 - sp3 : -65.16 -2.96 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to corner couldn't . [eos] cls2 - sp4 : -65.32 -2.97 23 0.73 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to telephone yes . [eos] cls3 - sp0 : -55.33 -2.51 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and corner telephone to telephone thought . [eos] cls3 - sp1 : -55.41 -2.52 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and made telephone to telephone thought . [eos] cls3 - sp2 : -55.41 -2.52 23 1.00 [bos] she the all were later , the personal corner over the telephone all property and corner telephone to telephone thought . [eos] cls3 - sp3 : -55.42 -2.52 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and corner telephone to corner thought . [eos] cls3 - sp4 : -55.44 -2.52 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and corner telephone to almost thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-81 src: none none 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt0: mod/noi/dif/loss/nce/logp -133.26/-2.09 /-131.17/0.73/-0.73 -6.06 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt1: mod/noi/dif/loss/nce/logp -133.26/-2.09 /-131.17/ /-0.73 -6.06 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt2: mod/noi/dif/loss/nce/logp -177.09/-13.06 /-164.02/ /-33.58 -8.43 /-0.62 22 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently [eos] tgt3: mod/noi/dif/loss/nce/logp -288.19/-12.18 /-276.01/ /-145.56 -41.17/-1.74 8 [bos] then the flames were gone . [eos] tgt4: mod/noi/dif/loss/nce/logp -147.32/-13.44 /-133.87/ /-3.43 -6.70 /-0.61 23 [bos] then the flames were gone , the stillness fell upon the severe photochemical face and richard began to tremble violently . [eos] tgt5: mod/noi/dif/loss/nce/logp -167.98/-13.22 /-154.76/ /-24.31 -7.30 /-0.57 24 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . . [eos] cls0 - sp0 : -53.99 -2.45 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined deck to cleaning joined . [eos] cls0 - sp1 : -54.01 -2.46 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined deck to cleaning be . [eos] cls0 - sp2 : -54.02 -2.46 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined cleaning to cleaning joined . [eos] cls0 - sp3 : -54.97 -2.50 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined cleaning to streets . ! [eos] cls0 - sp4 : -54.98 -2.50 23 0.00 [bos] she the first were i , the joined joined about the streets first couldn't and joined deck to streets . ! [eos] cls1 - sp0 : -57.24 -2.60 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined deck to editor . is [eos] cls1 - sp1 : -57.26 -2.60 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined cleaning to editor . is [eos] cls1 - sp2 : -57.42 -2.61 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined patience to editor . is [eos] cls1 - sp3 : -57.64 -2.62 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined deck to streets . ! [eos] cls1 - sp4 : -57.88 -2.63 23 0.27 [bos] she the first were ! , the joined discussed about the streets ! ! and joined deck to cleaning . is [eos] cls2 - sp0 : -64.52 -2.93 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to corner she . [eos] cls2 - sp1 : -65.12 -2.96 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to telephone she . [eos] cls2 - sp2 : -65.16 -2.96 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to corner thousand . [eos] cls2 - sp3 : -65.16 -2.96 23 0.64 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to corner couldn't . [eos] cls2 - sp4 : -65.32 -2.97 23 0.73 [bos] she the first were i , the corner mississippi over the laughed all property and laughed telephone to telephone yes . [eos] cls3 - sp0 : -55.33 -2.51 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and corner telephone to telephone thought . [eos] cls3 - sp1 : -55.41 -2.52 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and made telephone to telephone thought . [eos] cls3 - sp2 : -55.41 -2.52 23 1.00 [bos] she the all were later , the personal corner over the telephone all property and corner telephone to telephone thought . [eos] cls3 - sp3 : -55.42 -2.52 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and corner telephone to corner thought . [eos] cls3 - sp4 : -55.44 -2.52 23 1.00 [bos] she the first were later , the personal corner over the telephone all property and corner telephone to almost thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-82 src: none none 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt0: mod/noi/dif/loss/nce/logp -135.09/-2.09 /-133.00/0.82/-0.82 -6.14 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt1: mod/noi/dif/loss/nce/logp -135.09/-2.09 /-133.00/ /-0.82 -6.14 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt2: mod/noi/dif/loss/nce/logp -174.14/-13.06 /-161.08/ /-28.89 -8.29 /-0.62 22 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently [eos] tgt3: mod/noi/dif/loss/nce/logp -295.24/-12.18 /-283.06/ /-150.88 -42.18/-1.74 8 [bos] then the flames were gone . [eos] tgt4: mod/noi/dif/loss/nce/logp -147.78/-13.44 /-134.34/ /-2.15 -6.72 /-0.61 23 [bos] then the flames were gone , the stillness fell upon the severe photochemical face and richard began to tremble violently . [eos] tgt5: mod/noi/dif/loss/nce/logp -170.56/-13.22 /-157.34/ /-25.15 -7.42 /-0.57 24 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . . [eos] cls0 - sp0 : -57.15 -2.72 22 0.00 [bos] she the joined were cleaning , the joined cleaning over the streets first ! and editor ! to deck . [eos] cls0 - sp1 : -57.17 -2.72 22 0.00 [bos] she the joined were cleaning , the joined cleaning over the streets first ! and editor ! to streets . [eos] cls0 - sp2 : -57.29 -2.73 22 0.00 [bos] she the first were cleaning , the joined cleaning over the streets first ! and cleaning ! to deck . [eos] cls0 - sp3 : -57.29 -2.73 22 0.00 [bos] she the joined were cleaning , the joined cleaning over the streets first ! and cleaning ! to deck . [eos] cls0 - sp4 : -57.68 -2.75 22 0.00 [bos] we the joined were cleaning , the joined cleaning over the streets first ! and cleaning ! to deck . [eos] cls1 - sp0 : -65.45 -3.12 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and cleaning telephone to deck . [eos] cls1 - sp1 : -65.52 -3.12 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and editor ! to deck . [eos] cls1 - sp2 : -65.56 -3.12 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and cleaning ! to deck . [eos] cls1 - sp3 : -65.77 -3.13 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and editor ! to streets . [eos] cls1 - sp4 : -65.94 -3.14 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and cleaning telephone to firms . [eos] cls2 - sp0 : -62.09 -2.96 22 0.67 [bos] she the we were telephone , the joined mississippi over the telephone don't ! and telephone telephone to streets . [eos] cls2 - sp1 : -62.21 -2.96 22 0.67 [bos] she the we were telephone , the joined mississippi over the telephone ! ! and telephone telephone to streets . [eos] cls2 - sp2 : -62.73 -2.85 23 0.64 [bos] she the we were telephone , the joined mississippi over the telephone don't ! and telephone telephone to state she . [eos] cls2 - sp3 : -62.76 -2.85 23 0.64 [bos] she the we were telephone , the joined mississippi over the telephone don't ! and telephone telephone to streets she . [eos] cls2 - sp4 : -62.77 -2.85 23 0.64 [bos] she the we were telephone , the joined mississippi over the telephone ! ! and telephone telephone to state she . [eos] cls3 - sp0 : -56.81 -2.58 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all later and telephone telephone to state telephone . [eos] cls3 - sp1 : -56.87 -2.58 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all ! and telephone telephone to state telephone . [eos] cls3 - sp2 : -56.90 -2.59 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all later and telephone telephone to state corner . [eos] cls3 - sp3 : -56.91 -2.59 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all later and telephone telephone to state she . [eos] cls3 - sp4 : -56.93 -2.59 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone don't ! and telephone telephone to state telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-83 src: none none 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt0: mod/noi/dif/loss/nce/logp -134.37/-2.09 /-132.28/0.74/-0.74 -6.11 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt1: mod/noi/dif/loss/nce/logp -134.37/-2.09 /-132.28/ /-0.74 -6.11 /-0.09 23 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . [eos] tgt2: mod/noi/dif/loss/nce/logp -177.29/-13.06 /-164.23/ /-32.69 -8.44 /-0.62 22 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently [eos] tgt3: mod/noi/dif/loss/nce/logp -286.71/-12.18 /-274.53/ /-142.98 -40.96/-1.74 8 [bos] then the flames were gone . [eos] tgt4: mod/noi/dif/loss/nce/logp -148.17/-13.44 /-134.73/ /-3.18 -6.73 /-0.61 23 [bos] then the flames were gone , the stillness fell upon the severe photochemical face and richard began to tremble violently . [eos] tgt5: mod/noi/dif/loss/nce/logp -168.06/-13.22 /-154.84/ /-23.29 -7.31 /-0.57 24 [bos] then the flames were gone , the stillness fell upon the severe black face and richard began to tremble violently . . [eos] cls0 - sp0 : -57.15 -2.72 22 0.00 [bos] she the joined were cleaning , the joined cleaning over the streets first ! and editor ! to deck . [eos] cls0 - sp1 : -57.17 -2.72 22 0.00 [bos] she the joined were cleaning , the joined cleaning over the streets first ! and editor ! to streets . [eos] cls0 - sp2 : -57.29 -2.73 22 0.00 [bos] she the first were cleaning , the joined cleaning over the streets first ! and cleaning ! to deck . [eos] cls0 - sp3 : -57.29 -2.73 22 0.00 [bos] she the joined were cleaning , the joined cleaning over the streets first ! and cleaning ! to deck . [eos] cls0 - sp4 : -57.68 -2.75 22 0.00 [bos] we the joined were cleaning , the joined cleaning over the streets first ! and cleaning ! to deck . [eos] cls1 - sp0 : -65.45 -3.12 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and cleaning telephone to deck . [eos] cls1 - sp1 : -65.52 -3.12 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and editor ! to deck . [eos] cls1 - sp2 : -65.56 -3.12 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and cleaning ! to deck . [eos] cls1 - sp3 : -65.77 -3.13 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and editor ! to streets . [eos] cls1 - sp4 : -65.94 -3.14 22 0.29 [bos] she the first were telephone , the joined discussed over the streets ! ! and cleaning telephone to firms . [eos] cls2 - sp0 : -62.09 -2.96 22 0.67 [bos] she the we were telephone , the joined mississippi over the telephone don't ! and telephone telephone to streets . [eos] cls2 - sp1 : -62.21 -2.96 22 0.67 [bos] she the we were telephone , the joined mississippi over the telephone ! ! and telephone telephone to streets . [eos] cls2 - sp2 : -62.73 -2.85 23 0.64 [bos] she the we were telephone , the joined mississippi over the telephone don't ! and telephone telephone to state she . [eos] cls2 - sp3 : -62.76 -2.85 23 0.64 [bos] she the we were telephone , the joined mississippi over the telephone don't ! and telephone telephone to streets she . [eos] cls2 - sp4 : -62.77 -2.85 23 0.64 [bos] she the we were telephone , the joined mississippi over the telephone ! ! and telephone telephone to state she . [eos] cls3 - sp0 : -56.81 -2.58 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all later and telephone telephone to state telephone . [eos] cls3 - sp1 : -56.87 -2.58 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all ! and telephone telephone to state telephone . [eos] cls3 - sp2 : -56.90 -2.59 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all later and telephone telephone to state corner . [eos] cls3 - sp3 : -56.91 -2.59 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone all later and telephone telephone to state she . [eos] cls3 - sp4 : -56.93 -2.59 23 1.00 [bos] we the first were telephone , the corner telephone over the telephone don't ! and telephone telephone to state telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-84 src: none none 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt0: mod/noi/dif/loss/nce/logp -105.23/-3.08 /-102.15/0.7/-0.70 -3.76 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt1: mod/noi/dif/loss/nce/logp -105.23/-3.08 /-102.15/ /-0.70 -3.76 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt2: mod/noi/dif/loss/nce/logp -203.01/-12.32 /-190.69/ /-89.24 -101.50/-6.16 3 [bos] i [eos] tgt3: mod/noi/dif/loss/nce/logp -255.64/-12.69 /-242.94/ /-141.49 -31.95/-1.59 9 [bos] i was thinking of the heat . [eos] tgt4: mod/noi/dif/loss/nce/logp -139.16/-14.01 /-125.15/ /-23.70 -5.15 /-0.52 28 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings [eos] tgt5: mod/noi/dif/loss/nce/logp -121.12/-14.36 /-106.77/ /-5.32 -4.33 /-0.51 29 [bos] i was thinking of the heat and of water that morning the i was plowing the [unk] field far across the hill from the farm buildings . [eos] cls0 - sp0 : -55.67 -1.99 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined running . [eos] cls0 - sp1 : -55.72 -1.99 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined society . [eos] cls0 - sp2 : -55.77 -1.99 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined preceding . [eos] cls0 - sp3 : -55.87 -2.00 29 0.00 [bos] we was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined running . [eos] cls0 - sp4 : -55.89 -2.00 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] joined were other the united from the joined running . [eos] cls1 - sp0 : -63.58 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is discussed from the cleaning running . [eos] cls1 - sp1 : -63.58 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is discussed from the cleaning cleaning . [eos] cls1 - sp2 : -63.66 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is she from the cleaning cleaning . [eos] cls1 - sp3 : -63.70 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is discussed from the cleaning patience . [eos] cls1 - sp4 : -63.70 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is she from the cleaning running . [eos] cls2 - sp0 : -72.12 -2.58 29 0.71 [bos] we was later of the don't and of ! that flung when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls2 - sp1 : -72.23 -2.58 29 0.71 [bos] we was later of the don't and of ! that flung when i was telephone the [unk] telephone were other the thought from the telephone crime . [eos] cls2 - sp2 : -72.29 -2.58 29 0.71 [bos] we was later of the don't and of ! that flung when i was flung the [unk] 2 were other the thought from the telephone crime . [eos] cls2 - sp3 : -72.40 -2.59 29 0.71 [bos] we was later of the don't and of ! that flung when i was flung the [unk] telephone were other the thought from the telephone crime . [eos] cls2 - sp4 : -72.60 -2.59 29 0.71 [bos] we was later of the don't and of ! that flung when i was telephone the [unk] 2 were other the thought from the discussed crime . [eos] cls3 - sp0 : -56.46 -2.02 29 1.00 [bos] we was later of the first and of property that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp1 : -56.48 -2.02 29 1.00 [bos] we was later of the first and of state that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp2 : -56.53 -2.02 29 1.00 [bos] we was later of the first and of united that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp3 : -56.56 -2.02 29 1.00 [bos] she was later of the first and of property that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp4 : -56.58 -2.02 29 1.00 [bos] she was later of the first and of state that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-85 src: none none 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt0: mod/noi/dif/loss/nce/logp -104.29/-3.08 /-101.21/0.7/-0.70 -3.72 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt1: mod/noi/dif/loss/nce/logp -104.29/-3.08 /-101.21/ /-0.70 -3.72 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt2: mod/noi/dif/loss/nce/logp -206.99/-12.32 /-194.67/ /-94.16 -103.50/-6.16 3 [bos] i [eos] tgt3: mod/noi/dif/loss/nce/logp -253.49/-12.69 /-240.80/ /-140.29 -31.69/-1.59 9 [bos] i was thinking of the heat . [eos] tgt4: mod/noi/dif/loss/nce/logp -146.67/-14.01 /-132.66/ /-32.15 -5.43 /-0.52 28 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings [eos] tgt5: mod/noi/dif/loss/nce/logp -120.23/-14.36 /-105.88/ /-5.37 -4.29 /-0.51 29 [bos] i was thinking of the heat and of water that morning the i was plowing the [unk] field far across the hill from the farm buildings . [eos] cls0 - sp0 : -55.67 -1.99 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined running . [eos] cls0 - sp1 : -55.72 -1.99 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined society . [eos] cls0 - sp2 : -55.77 -1.99 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined preceding . [eos] cls0 - sp3 : -55.87 -2.00 29 0.00 [bos] we was there of the streets and of united that cleaning when i was cleaning the [unk] streets were other the united from the joined running . [eos] cls0 - sp4 : -55.89 -2.00 29 0.00 [bos] i was there of the streets and of united that cleaning when i was cleaning the [unk] joined were other the united from the joined running . [eos] cls1 - sp0 : -63.58 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is discussed from the cleaning running . [eos] cls1 - sp1 : -63.58 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is discussed from the cleaning cleaning . [eos] cls1 - sp2 : -63.66 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is she from the cleaning cleaning . [eos] cls1 - sp3 : -63.70 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is discussed from the cleaning patience . [eos] cls1 - sp4 : -63.70 -2.27 29 0.25 [bos] we was later of the don't and of ! that abscesses when i was cleaning the [unk] ! were . is she from the cleaning running . [eos] cls2 - sp0 : -72.12 -2.58 29 0.71 [bos] we was later of the don't and of ! that flung when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls2 - sp1 : -72.23 -2.58 29 0.71 [bos] we was later of the don't and of ! that flung when i was telephone the [unk] telephone were other the thought from the telephone crime . [eos] cls2 - sp2 : -72.29 -2.58 29 0.71 [bos] we was later of the don't and of ! that flung when i was flung the [unk] 2 were other the thought from the telephone crime . [eos] cls2 - sp3 : -72.40 -2.59 29 0.71 [bos] we was later of the don't and of ! that flung when i was flung the [unk] telephone were other the thought from the telephone crime . [eos] cls2 - sp4 : -72.60 -2.59 29 0.71 [bos] we was later of the don't and of ! that flung when i was telephone the [unk] 2 were other the thought from the discussed crime . [eos] cls3 - sp0 : -56.46 -2.02 29 1.00 [bos] we was later of the first and of property that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp1 : -56.48 -2.02 29 1.00 [bos] we was later of the first and of state that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp2 : -56.53 -2.02 29 1.00 [bos] we was later of the first and of united that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp3 : -56.56 -2.02 29 1.00 [bos] she was later of the first and of property that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] cls3 - sp4 : -56.58 -2.02 29 1.00 [bos] she was later of the first and of state that telephone when i was telephone the [unk] 2 were other the thought from the telephone crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-86 src: none none 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt0: mod/noi/dif/loss/nce/logp -104.07/-3.08 /-100.99/0.69/-0.69 -3.72 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt1: mod/noi/dif/loss/nce/logp -104.07/-3.08 /-100.99/ /-0.69 -3.72 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt2: mod/noi/dif/loss/nce/logp -185.19/-12.32 /-172.87/ /-72.57 -92.59/-6.16 3 [bos] i [eos] tgt3: mod/noi/dif/loss/nce/logp -258.05/-12.69 /-245.36/ /-145.06 -32.26/-1.59 9 [bos] i was thinking of the heat . [eos] tgt4: mod/noi/dif/loss/nce/logp -139.71/-14.01 /-125.70/ /-25.41 -5.17 /-0.52 28 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings [eos] tgt5: mod/noi/dif/loss/nce/logp -121.02/-14.36 /-106.67/ /-6.37 -4.32 /-0.51 29 [bos] i was thinking of the heat and of water that morning the i was plowing the [unk] field far across the hill from the farm buildings . [eos] cls0 - sp0 : -54.17 -1.93 29 0.00 [bos] we was all of the streets and of united that states when i was joined the [unk] preceding under and the streets from the most joined . [eos] cls0 - sp1 : -54.22 -1.94 29 0.00 [bos] we was all of the streets and of united that states when i was joined the [unk] preceding under and the streets from the most preceding . [eos] cls0 - sp2 : -54.31 -1.94 29 0.00 [bos] we was all of the streets and of united that later when i was joined the [unk] preceding under and the streets from the most joined . [eos] cls0 - sp3 : -54.33 -1.94 29 0.00 [bos] we was all of the streets and of united that later when i was joined the [unk] preceding under and the streets from the most preceding . [eos] cls0 - sp4 : -54.39 -1.94 29 0.00 [bos] we was all of the streets and of united that states when i was joined the [unk] preceding under and the joined from the most joined . [eos] cls1 - sp0 : -57.62 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the most patience . [eos] cls1 - sp1 : -57.69 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the most cleaning . [eos] cls1 - sp2 : -57.71 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the first patience . [eos] cls1 - sp3 : -57.74 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the couldn't patience . [eos] cls1 - sp4 : -57.82 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the first cleaning . [eos] cls2 - sp0 : -56.08 -2.00 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the don't discussed . [eos] cls2 - sp1 : -56.21 -2.01 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the corner discussed . [eos] cls2 - sp2 : -56.32 -2.01 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the personal discussed . [eos] cls2 - sp3 : -56.39 -2.01 29 0.71 [bos] she was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the don't discussed . [eos] cls2 - sp4 : -56.42 -2.01 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the somewhere discussed . [eos] cls3 - sp0 : -51.86 -1.85 29 1.00 [bos] she was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the corner reliable . [eos] cls3 - sp1 : -51.90 -1.85 29 1.00 [bos] she was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the personal reliable . [eos] cls3 - sp2 : -51.91 -1.85 29 1.00 [bos] she was all of the personal and of later that personal when i was telephone the [unk] made were and the telephone from the corner reliable . [eos] cls3 - sp3 : -51.93 -1.85 29 1.00 [bos] she was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the corner mississippi . [eos] cls3 - sp4 : -51.95 -1.86 29 1.00 [bos] we was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the corner reliable . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-87 src: none none 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt0: mod/noi/dif/loss/nce/logp -104.03/-3.08 /-100.95/0.69/-0.69 -3.72 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt1: mod/noi/dif/loss/nce/logp -104.03/-3.08 /-100.95/ /-0.69 -3.72 /-0.11 29 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings . [eos] tgt2: mod/noi/dif/loss/nce/logp -190.72/-12.32 /-178.40/ /-78.14 -95.36/-6.16 3 [bos] i [eos] tgt3: mod/noi/dif/loss/nce/logp -257.69/-12.69 /-245.00/ /-144.74 -32.21/-1.59 9 [bos] i was thinking of the heat . [eos] tgt4: mod/noi/dif/loss/nce/logp -146.25/-14.01 /-132.24/ /-31.98 -5.42 /-0.52 28 [bos] i was thinking of the heat and of water that morning when i was plowing the [unk] field far across the hill from the farm buildings [eos] tgt5: mod/noi/dif/loss/nce/logp -121.36/-14.36 /-107.00/ /-6.75 -4.33 /-0.51 29 [bos] i was thinking of the heat and of water that morning the i was plowing the [unk] field far across the hill from the farm buildings . [eos] cls0 - sp0 : -54.17 -1.93 29 0.00 [bos] we was all of the streets and of united that states when i was joined the [unk] preceding under and the streets from the most joined . [eos] cls0 - sp1 : -54.22 -1.94 29 0.00 [bos] we was all of the streets and of united that states when i was joined the [unk] preceding under and the streets from the most preceding . [eos] cls0 - sp2 : -54.31 -1.94 29 0.00 [bos] we was all of the streets and of united that later when i was joined the [unk] preceding under and the streets from the most joined . [eos] cls0 - sp3 : -54.33 -1.94 29 0.00 [bos] we was all of the streets and of united that later when i was joined the [unk] preceding under and the streets from the most preceding . [eos] cls0 - sp4 : -54.39 -1.94 29 0.00 [bos] we was all of the streets and of united that states when i was joined the [unk] preceding under and the joined from the most joined . [eos] cls1 - sp0 : -57.62 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the most patience . [eos] cls1 - sp1 : -57.69 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the most cleaning . [eos] cls1 - sp2 : -57.71 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the first patience . [eos] cls1 - sp3 : -57.74 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the couldn't patience . [eos] cls1 - sp4 : -57.82 -2.06 29 0.36 [bos] she was she of the later and of ! that ! when i was telephone the [unk] preceding were and the telephone from the first cleaning . [eos] cls2 - sp0 : -56.08 -2.00 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the don't discussed . [eos] cls2 - sp1 : -56.21 -2.01 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the corner discussed . [eos] cls2 - sp2 : -56.32 -2.01 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the personal discussed . [eos] cls2 - sp3 : -56.39 -2.01 29 0.71 [bos] she was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the don't discussed . [eos] cls2 - sp4 : -56.42 -2.01 29 0.71 [bos] we was she of the later and of later that personal when i was telephone the [unk] discussed were and the telephone from the somewhere discussed . [eos] cls3 - sp0 : -51.86 -1.85 29 1.00 [bos] she was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the corner reliable . [eos] cls3 - sp1 : -51.90 -1.85 29 1.00 [bos] she was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the personal reliable . [eos] cls3 - sp2 : -51.91 -1.85 29 1.00 [bos] she was all of the personal and of later that personal when i was telephone the [unk] made were and the telephone from the corner reliable . [eos] cls3 - sp3 : -51.93 -1.85 29 1.00 [bos] she was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the corner mississippi . [eos] cls3 - sp4 : -51.95 -1.86 29 1.00 [bos] we was all of the later and of later that personal when i was telephone the [unk] made were and the telephone from the corner reliable . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-88 src: none none 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt0: mod/noi/dif/loss/nce/logp -118.12/-2.16 /-115.96/0.69/-0.69 -5.37 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt1: mod/noi/dif/loss/nce/logp -118.12/-2.16 /-115.96/ /-0.69 -5.37 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt2: mod/noi/dif/loss/nce/logp -157.40/-13.13 /-144.28/ /-29.01 -7.50 /-0.63 22 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly [eos] tgt3: mod/noi/dif/loss/nce/logp -193.52/-12.23 /-181.29/ /-66.03 -64.51/-4.08 4 [bos] the tractor [eos] tgt4: mod/noi/dif/loss/nce/logp -313.90/-12.96 /-300.94/ /-185.68 -19.62/-0.81 17 [bos] the tractor was heavily loaded with the weight of the plow turning the earth . [eos] tgt5: mod/noi/dif/loss/nce/logp -154.34/-13.31 /-141.02/ /-25.76 -6.71 /-0.58 24 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . . [eos] cls0 - sp0 : -13.48 -2.70 6 0.20 [bos] : editor was 7 [eos] cls0 - sp1 : -14.41 -2.88 6 0.20 [bos] : 7 was cleaning [eos] cls0 - sp2 : -15.57 -3.11 6 0.20 [bos] : don't was cleaning [eos] cls0 - sp3 : -15.95 -3.19 6 0.00 [bos] : pain was cleaning [eos] cls0 - sp4 : -16.37 -3.27 6 0.00 [bos] : streets was cleaning [eos] cls1 - sp0 : -15.31 -3.06 6 0.40 [bos] she corner was patience [eos] cls1 - sp1 : -16.19 -3.24 6 0.40 [bos] she corner was streets [eos] cls1 - sp2 : -17.01 -3.40 6 0.40 [bos] she corner was cleaning [eos] cls1 - sp3 : -17.34 -3.47 6 0.40 [bos] she corner was editor [eos] cls1 - sp4 : -18.06 -3.61 6 0.40 [bos] she corner was receiving [eos] cls2 - sp0 : -58.01 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone it the corner , and the telephone crime bidding . [eos] cls2 - sp1 : -58.07 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone if the corner , and the telephone telephone bidding . [eos] cls2 - sp2 : -58.12 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone it the corner , and the telephone telephone bidding . [eos] cls2 - sp3 : -58.13 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone if the corner , and the telephone telephone pragmatic . [eos] cls2 - sp4 : -58.14 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone it the corner , and the telephone telephone pragmatic . [eos] cls3 - sp0 : -50.48 -2.29 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the corner , and the telephone crime telephone . [eos] cls3 - sp1 : -50.51 -2.30 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the telephone , and the telephone crime telephone . [eos] cls3 - sp2 : -50.57 -2.30 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the telephone , and the telephone crime crime . [eos] cls3 - sp3 : -50.64 -2.30 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the corner , and the telephone crime crime . [eos] cls3 - sp4 : -50.72 -2.31 23 1.00 [bos] she telephone was personal crime with the ( of the telephone it the telephone , and the telephone crime crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-89 src: none none 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt0: mod/noi/dif/loss/nce/logp -123.21/-2.16 /-121.05/0.69/-0.69 -5.60 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt1: mod/noi/dif/loss/nce/logp -123.21/-2.16 /-121.05/ /-0.69 -5.60 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt2: mod/noi/dif/loss/nce/logp -166.72/-13.13 /-153.60/ /-33.24 -7.94 /-0.63 22 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly [eos] tgt3: mod/noi/dif/loss/nce/logp -195.10/-12.23 /-182.87/ /-62.52 -65.03/-4.08 4 [bos] the tractor [eos] tgt4: mod/noi/dif/loss/nce/logp -323.92/-12.96 /-310.97/ /-190.61 -20.25/-0.81 17 [bos] the tractor was heavily loaded with the weight of the plow turning the earth . [eos] tgt5: mod/noi/dif/loss/nce/logp -157.92/-13.31 /-144.60/ /-24.25 -6.87 /-0.58 24 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . . [eos] cls0 - sp0 : -13.48 -2.70 6 0.20 [bos] : editor was 7 [eos] cls0 - sp1 : -14.41 -2.88 6 0.20 [bos] : 7 was cleaning [eos] cls0 - sp2 : -15.57 -3.11 6 0.20 [bos] : don't was cleaning [eos] cls0 - sp3 : -15.95 -3.19 6 0.00 [bos] : pain was cleaning [eos] cls0 - sp4 : -16.37 -3.27 6 0.00 [bos] : streets was cleaning [eos] cls1 - sp0 : -15.31 -3.06 6 0.40 [bos] she corner was patience [eos] cls1 - sp1 : -16.19 -3.24 6 0.40 [bos] she corner was streets [eos] cls1 - sp2 : -17.01 -3.40 6 0.40 [bos] she corner was cleaning [eos] cls1 - sp3 : -17.34 -3.47 6 0.40 [bos] she corner was editor [eos] cls1 - sp4 : -18.06 -3.61 6 0.40 [bos] she corner was receiving [eos] cls2 - sp0 : -58.01 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone it the corner , and the telephone crime bidding . [eos] cls2 - sp1 : -58.07 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone if the corner , and the telephone telephone bidding . [eos] cls2 - sp2 : -58.12 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone it the corner , and the telephone telephone bidding . [eos] cls2 - sp3 : -58.13 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone if the corner , and the telephone telephone pragmatic . [eos] cls2 - sp4 : -58.14 -2.64 23 0.73 [bos] she corner was cleaning tips with the ( of the telephone it the corner , and the telephone telephone pragmatic . [eos] cls3 - sp0 : -50.48 -2.29 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the corner , and the telephone crime telephone . [eos] cls3 - sp1 : -50.51 -2.30 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the telephone , and the telephone crime telephone . [eos] cls3 - sp2 : -50.57 -2.30 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the telephone , and the telephone crime crime . [eos] cls3 - sp3 : -50.64 -2.30 23 1.00 [bos] she telephone was personal crime with the ( of the corner it the corner , and the telephone crime crime . [eos] cls3 - sp4 : -50.72 -2.31 23 1.00 [bos] she telephone was personal crime with the ( of the telephone it the telephone , and the telephone crime crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-90 src: none none 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt0: mod/noi/dif/loss/nce/logp -120.41/-2.16 /-118.25/0.69/-0.69 -5.47 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt1: mod/noi/dif/loss/nce/logp -120.41/-2.16 /-118.25/ /-0.69 -5.47 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt2: mod/noi/dif/loss/nce/logp -158.15/-13.13 /-145.02/ /-27.47 -7.53 /-0.63 22 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly [eos] tgt3: mod/noi/dif/loss/nce/logp -166.85/-12.23 /-154.62/ /-37.06 -55.62/-4.08 4 [bos] the tractor [eos] tgt4: mod/noi/dif/loss/nce/logp -205.30/-12.96 /-192.34/ /-74.79 -12.83/-0.81 17 [bos] the tractor was heavily loaded with the weight of the plow turning the earth . [eos] tgt5: mod/noi/dif/loss/nce/logp -155.29/-13.31 /-141.97/ /-24.42 -6.75 /-0.58 24 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . . [eos] cls0 - sp0 : -14.15 -2.83 6 0.20 [bos] : streets was 7 [eos] cls0 - sp1 : -14.43 -2.89 6 0.20 [bos] : couldn't was 7 [eos] cls0 - sp2 : -14.44 -2.89 6 0.20 [bos] : joined was 7 [eos] cls0 - sp3 : -14.65 -2.93 6 0.20 [bos] : editor was 7 [eos] cls0 - sp4 : -15.74 -3.15 6 0.20 [bos] : streets was laughed [eos] cls1 - sp0 : -16.92 -3.38 6 0.40 [bos] she corner was wonder [eos] cls1 - sp1 : -17.26 -3.45 6 0.40 [bos] she corner was joined [eos] cls1 - sp2 : -17.90 -3.58 6 0.40 [bos] she corner was mean [eos] cls1 - sp3 : -18.68 -3.74 6 0.40 [bos] she corner was sources [eos] cls1 - sp4 : -18.80 -3.76 6 0.40 [bos] she corner was ace [eos] cls2 - sp0 : -52.12 -2.37 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each telephone . [eos] cls2 - sp1 : -52.25 -2.37 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the don't , and the telephone each telephone . [eos] cls2 - sp2 : -52.38 -2.38 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each mississippi . [eos] cls2 - sp3 : -52.42 -2.38 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each indifferent . [eos] cls2 - sp4 : -52.42 -2.38 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each flung . [eos] cls3 - sp0 : -48.30 -2.20 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the don't , and the telephone each telephone . [eos] cls3 - sp1 : -48.39 -2.20 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the corner , and the telephone each telephone . [eos] cls3 - sp2 : -48.41 -2.20 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the don't , and the telephone each mississippi . [eos] cls3 - sp3 : -48.51 -2.21 23 1.00 [bos] she telephone was personal streets with the corner of the ! i the don't , and the telephone each telephone . [eos] cls3 - sp4 : -48.53 -2.21 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the don't , and the telephone each crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-91 src: none none 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt0: mod/noi/dif/loss/nce/logp -126.51/-2.16 /-124.34/0.69/-0.69 -5.75 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt1: mod/noi/dif/loss/nce/logp -126.51/-2.16 /-124.34/ /-0.69 -5.75 /-0.10 23 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . [eos] tgt2: mod/noi/dif/loss/nce/logp -169.80/-13.13 /-156.67/ /-33.02 -8.09 /-0.63 22 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly [eos] tgt3: mod/noi/dif/loss/nce/logp -166.94/-12.23 /-154.71/ /-31.06 -55.65/-4.08 4 [bos] the tractor [eos] tgt4: mod/noi/dif/loss/nce/logp -265.99/-12.96 /-253.03/ /-129.38 -16.62/-0.81 17 [bos] the tractor was heavily loaded with the weight of the plow turning the earth . [eos] tgt5: mod/noi/dif/loss/nce/logp -159.77/-13.31 /-146.46/ /-22.81 -6.95 /-0.58 24 [bos] the tractor was heavily loaded with the weight of the plow turning the earth , and the tractor stopped instantly . . [eos] cls0 - sp0 : -14.15 -2.83 6 0.20 [bos] : streets was 7 [eos] cls0 - sp1 : -14.43 -2.89 6 0.20 [bos] : couldn't was 7 [eos] cls0 - sp2 : -14.44 -2.89 6 0.20 [bos] : joined was 7 [eos] cls0 - sp3 : -14.65 -2.93 6 0.20 [bos] : editor was 7 [eos] cls0 - sp4 : -15.74 -3.15 6 0.20 [bos] : streets was laughed [eos] cls1 - sp0 : -16.92 -3.38 6 0.40 [bos] she corner was wonder [eos] cls1 - sp1 : -17.26 -3.45 6 0.40 [bos] she corner was joined [eos] cls1 - sp2 : -17.90 -3.58 6 0.40 [bos] she corner was mean [eos] cls1 - sp3 : -18.68 -3.74 6 0.40 [bos] she corner was sources [eos] cls1 - sp4 : -18.80 -3.76 6 0.40 [bos] she corner was ace [eos] cls2 - sp0 : -52.12 -2.37 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each telephone . [eos] cls2 - sp1 : -52.25 -2.37 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the don't , and the telephone each telephone . [eos] cls2 - sp2 : -52.38 -2.38 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each mississippi . [eos] cls2 - sp3 : -52.42 -2.38 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each indifferent . [eos] cls2 - sp4 : -52.42 -2.38 23 0.73 [bos] she corner was joined discussed with the couldn't of the ! i the she , and the telephone each flung . [eos] cls3 - sp0 : -48.30 -2.20 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the don't , and the telephone each telephone . [eos] cls3 - sp1 : -48.39 -2.20 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the corner , and the telephone each telephone . [eos] cls3 - sp2 : -48.41 -2.20 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the don't , and the telephone each mississippi . [eos] cls3 - sp3 : -48.51 -2.21 23 1.00 [bos] she telephone was personal streets with the corner of the ! i the don't , and the telephone each telephone . [eos] cls3 - sp4 : -48.53 -2.21 23 1.00 [bos] she telephone was personal crime with the corner of the ! i the don't , and the telephone each crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-92 src: none none 9 [bos] `` this snake was very beautiful . [eos] tgt0: mod/noi/dif/loss/nce/logp -33.90 /-0.88 /-33.02 /0.7/-0.70 -4.24 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt1: mod/noi/dif/loss/nce/logp -33.90 /-0.88 /-33.02 / /-0.70 -4.24 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt2: mod/noi/dif/loss/nce/logp -53.07 /-11.58 /-41.49 / /-9.16 -6.63 /-1.45 9 [bos] `` the snake was very beautiful . [eos] tgt3: mod/noi/dif/loss/nce/logp -60.32 /-11.81 /-48.51 / /-16.18 -8.62 /-1.69 8 [bos] `` this snake was very beautiful [eos] tgt4: mod/noi/dif/loss/nce/logp -50.12 /-11.72 /-38.40 / /-6.08 -6.27 /-1.47 9 [bos] `` a snake was very beautiful . [eos] tgt5: mod/noi/dif/loss/nce/logp -54.86 /-11.82 /-43.04 / /-10.71 -6.86 /-1.48 9 [bos] a this snake was very beautiful . [eos] cls0 - sp0 : -9.11 -1.14 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp1 : -9.20 -1.84 6 0.20 [bos] she ! ! ! [eos] cls0 - sp2 : -9.45 -1.18 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp3 : -9.80 -1.23 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp4 : -9.86 -1.23 9 0.00 [bos] ! ! ! ! ! ! . [eos] cls1 - sp0 : -8.12 -1.01 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp1 : -8.15 -1.02 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp2 : -8.48 -1.06 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp3 : -8.52 -1.07 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls1 - sp4 : -8.86 -1.11 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls2 - sp0 : -6.73 -0.84 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp1 : -7.13 -0.89 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp2 : -7.26 -0.91 9 0.50 [bos] ! ! ! ! ! ! . [eos] cls2 - sp3 : -7.58 -0.95 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp4 : -7.74 -0.97 9 0.50 [bos] ! ! ! ! ! ! . [eos] cls3 - sp0 : -6.50 -0.81 9 0.75 [bos] ! ! ! ! ! ! . [eos] cls3 - sp1 : -7.91 -0.99 9 0.75 [bos] she ! ! ! ! ! . [eos] cls3 - sp2 : -8.36 -1.04 9 0.88 [bos] ! ! ! ! ! ! . [eos] cls3 - sp3 : -8.36 -1.05 9 0.88 [bos] ! ! ! ! ! ! ! [eos] cls3 - sp4 : -8.39 -1.05 9 0.75 [bos] ! ! ! she ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-93 src: none none 9 [bos] `` this snake was very beautiful . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.21 /-0.88 /-33.33 /0.7/-0.70 -4.28 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.21 /-0.88 /-33.33 / /-0.70 -4.28 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.51 /-11.58 /-43.93 / /-11.30 -6.94 /-1.45 9 [bos] `` the snake was very beautiful . [eos] tgt3: mod/noi/dif/loss/nce/logp -67.85 /-11.81 /-56.04 / /-23.41 -9.69 /-1.69 8 [bos] `` this snake was very beautiful [eos] tgt4: mod/noi/dif/loss/nce/logp -50.46 /-11.72 /-38.73 / /-6.10 -6.31 /-1.47 9 [bos] `` a snake was very beautiful . [eos] tgt5: mod/noi/dif/loss/nce/logp -54.24 /-11.82 /-42.42 / /-9.79 -6.78 /-1.48 9 [bos] a this snake was very beautiful . [eos] cls0 - sp0 : -9.11 -1.14 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp1 : -9.20 -1.84 6 0.20 [bos] she ! ! ! [eos] cls0 - sp2 : -9.45 -1.18 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp3 : -9.80 -1.23 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp4 : -9.86 -1.23 9 0.00 [bos] ! ! ! ! ! ! . [eos] cls1 - sp0 : -8.12 -1.01 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp1 : -8.15 -1.02 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp2 : -8.48 -1.06 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp3 : -8.52 -1.07 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls1 - sp4 : -8.86 -1.11 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls2 - sp0 : -6.73 -0.84 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp1 : -7.13 -0.89 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp2 : -7.26 -0.91 9 0.50 [bos] ! ! ! ! ! ! . [eos] cls2 - sp3 : -7.58 -0.95 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp4 : -7.74 -0.97 9 0.50 [bos] ! ! ! ! ! ! . [eos] cls3 - sp0 : -6.50 -0.81 9 0.75 [bos] ! ! ! ! ! ! . [eos] cls3 - sp1 : -7.91 -0.99 9 0.75 [bos] she ! ! ! ! ! . [eos] cls3 - sp2 : -8.36 -1.04 9 0.88 [bos] ! ! ! ! ! ! . [eos] cls3 - sp3 : -8.36 -1.05 9 0.88 [bos] ! ! ! ! ! ! ! [eos] cls3 - sp4 : -8.39 -1.05 9 0.75 [bos] ! ! ! she ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-94 src: none none 9 [bos] `` this snake was very beautiful . [eos] tgt0: mod/noi/dif/loss/nce/logp -33.89 /-0.88 /-33.01 /0.7/-0.70 -4.24 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt1: mod/noi/dif/loss/nce/logp -33.89 /-0.88 /-33.01 / /-0.70 -4.24 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt2: mod/noi/dif/loss/nce/logp -52.94 /-11.58 /-41.36 / /-9.05 -6.62 /-1.45 9 [bos] `` the snake was very beautiful . [eos] tgt3: mod/noi/dif/loss/nce/logp -61.86 /-11.81 /-50.05 / /-17.74 -8.84 /-1.69 8 [bos] `` this snake was very beautiful [eos] tgt4: mod/noi/dif/loss/nce/logp -49.93 /-11.72 /-38.21 / /-5.90 -6.24 /-1.47 9 [bos] `` a snake was very beautiful . [eos] tgt5: mod/noi/dif/loss/nce/logp -53.59 /-11.82 /-41.77 / /-9.46 -6.70 /-1.48 9 [bos] a this snake was very beautiful . [eos] cls0 - sp0 : -10.53 -1.32 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp1 : -10.57 -1.32 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp2 : -10.95 -1.37 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp3 : -11.07 -1.38 9 0.00 [bos] ! ! ! ! ! ! . [eos] cls0 - sp4 : -11.42 -1.43 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls1 - sp0 : -9.29 -1.16 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp1 : -9.40 -1.18 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp2 : -9.42 -1.18 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp3 : -9.86 -1.23 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls1 - sp4 : -10.10 -1.26 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls2 - sp0 : -7.70 -0.96 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp1 : -7.71 -0.96 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp2 : -8.29 -1.04 9 0.50 [bos] ! ! ! ! ! ! . [eos] cls2 - sp3 : -8.46 -1.06 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp4 : -8.47 -1.06 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls3 - sp0 : -7.03 -0.88 9 0.75 [bos] ! ! ! ! ! ! . [eos] cls3 - sp1 : -8.94 -1.12 9 0.88 [bos] ! ! ! ! ! ! . [eos] cls3 - sp2 : -9.30 -1.16 9 0.75 [bos] she ! ! ! ! ! . [eos] cls3 - sp3 : -9.63 -1.20 9 0.75 [bos] ! ! ! she ! ! . [eos] cls3 - sp4 : -9.82 -1.23 9 0.75 [bos] ! ! ! ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-95 src: none none 9 [bos] `` this snake was very beautiful . [eos] tgt0: mod/noi/dif/loss/nce/logp -35.87 /-0.88 /-34.99 /0.7/-0.70 -4.48 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt1: mod/noi/dif/loss/nce/logp -35.87 /-0.88 /-34.99 / /-0.70 -4.48 /-0.11 9 [bos] `` this snake was very beautiful . [eos] tgt2: mod/noi/dif/loss/nce/logp -56.98 /-11.58 /-45.40 / /-11.11 -7.12 /-1.45 9 [bos] `` the snake was very beautiful . [eos] tgt3: mod/noi/dif/loss/nce/logp -69.97 /-11.81 /-58.16 / /-23.86 -10.00/-1.69 8 [bos] `` this snake was very beautiful [eos] tgt4: mod/noi/dif/loss/nce/logp -51.64 /-11.72 /-39.91 / /-5.62 -6.45 /-1.47 9 [bos] `` a snake was very beautiful . [eos] tgt5: mod/noi/dif/loss/nce/logp -54.56 /-11.82 /-42.74 / /-8.44 -6.82 /-1.48 9 [bos] a this snake was very beautiful . [eos] cls0 - sp0 : -10.53 -1.32 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp1 : -10.57 -1.32 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp2 : -10.95 -1.37 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls0 - sp3 : -11.07 -1.38 9 0.00 [bos] ! ! ! ! ! ! . [eos] cls0 - sp4 : -11.42 -1.43 9 0.12 [bos] ! ! ! ! ! ! . [eos] cls1 - sp0 : -9.29 -1.16 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp1 : -9.40 -1.18 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp2 : -9.42 -1.18 9 0.38 [bos] ! ! ! ! ! ! . [eos] cls1 - sp3 : -9.86 -1.23 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls1 - sp4 : -10.10 -1.26 9 0.25 [bos] ! ! ! ! ! ! . [eos] cls2 - sp0 : -7.70 -0.96 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp1 : -7.71 -0.96 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp2 : -8.29 -1.04 9 0.50 [bos] ! ! ! ! ! ! . [eos] cls2 - sp3 : -8.46 -1.06 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls2 - sp4 : -8.47 -1.06 9 0.62 [bos] ! ! ! ! ! ! . [eos] cls3 - sp0 : -7.03 -0.88 9 0.75 [bos] ! ! ! ! ! ! . [eos] cls3 - sp1 : -8.94 -1.12 9 0.88 [bos] ! ! ! ! ! ! . [eos] cls3 - sp2 : -9.30 -1.16 9 0.75 [bos] she ! ! ! ! ! . [eos] cls3 - sp3 : -9.63 -1.20 9 0.75 [bos] ! ! ! she ! ! . [eos] cls3 - sp4 : -9.82 -1.23 9 0.75 [bos] ! ! ! ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-96 src: none none 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt0: mod/noi/dif/loss/nce/logp -36.18 /-1.66 /-34.52 /0.69/-0.69 -2.58 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt1: mod/noi/dif/loss/nce/logp -36.18 /-1.66 /-34.52 / /-0.69 -2.58 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt2: mod/noi/dif/loss/nce/logp -148.06/-12.03 /-136.03/ /-102.21 -29.61/-2.41 6 [bos] `` it was beautiful [eos] tgt3: mod/noi/dif/loss/nce/logp -111.71/-27.24 /-84.47 / /-50.65 -7.98 /-1.95 15 [bos] `` it was beautiful . , i said , half to myself . [eos] tgt4: mod/noi/dif/loss/nce/logp -161.11/-12.28 /-148.83/ /-115.00 -23.02/-1.75 8 [bos] `` it was beautiful '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -69.06 /-12.59 /-56.47 / /-22.65 -5.31 /-0.97 14 [bos] `` it was beautiful '' , i said , half to myself [eos] cls0 - sp0 : -16.26 -1.16 15 0.00 [bos] '' it was any '' , i or , ! to i . [eos] cls0 - sp1 : -16.27 -1.16 15 0.00 [bos] she it was any '' , i or , ! to i . [eos] cls0 - sp2 : -16.41 -1.17 15 0.00 [bos] when it was any '' , i or , ! to i . [eos] cls0 - sp3 : -16.87 -1.20 15 0.00 [bos] : it was any '' , i or , ! to i . [eos] cls0 - sp4 : -16.90 -1.21 15 0.00 [bos] '' it was later '' , i or , ! to i . [eos] cls1 - sp0 : -21.66 -1.55 15 0.29 [bos] she it was any '' , i or , ! to i . [eos] cls1 - sp1 : -21.86 -1.56 15 0.29 [bos] she it was any '' , i had , ! to i . [eos] cls1 - sp2 : -21.94 -1.57 15 0.36 [bos] she it was any '' , i or , ! to i . [eos] cls1 - sp3 : -21.97 -1.57 15 0.29 [bos] she it was ! '' , i had , ! to i . [eos] cls1 - sp4 : -22.05 -1.57 15 0.36 [bos] she it was ! '' , i or , ! to i . [eos] cls2 - sp0 : -23.90 -1.71 15 0.50 [bos] she it was ! '' , i had , ! to she . [eos] cls2 - sp1 : -24.58 -1.76 15 0.50 [bos] she it was ! '' , i or , ! to she . [eos] cls2 - sp2 : -24.59 -1.76 15 0.57 [bos] she it was ! '' , i had , ! to she . [eos] cls2 - sp3 : -24.69 -1.76 15 0.64 [bos] she it was ! '' , i had , ! to she . [eos] cls2 - sp4 : -24.87 -1.78 15 0.57 [bos] she it was ! '' , i or , ! to she . [eos] cls3 - sp0 : -18.59 -1.33 15 1.00 [bos] she it was later '' , i life , ! to she . [eos] cls3 - sp1 : -18.61 -1.33 15 1.00 [bos] she it was later '' , i life , ! to i . [eos] cls3 - sp2 : -18.71 -1.34 15 1.00 [bos] she it was life '' , i life , ! to she . [eos] cls3 - sp3 : -18.77 -1.34 15 1.00 [bos] she it was life '' , i life , ! to i . [eos] cls3 - sp4 : -18.80 -1.34 15 1.00 [bos] she it was later '' , i life , ! to all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-97 src: none none 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt0: mod/noi/dif/loss/nce/logp -39.59 /-1.66 /-37.93 /0.69/-0.69 -2.83 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt1: mod/noi/dif/loss/nce/logp -39.59 /-1.66 /-37.93 / /-0.69 -2.83 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt2: mod/noi/dif/loss/nce/logp -144.14/-12.03 /-132.11/ /-94.87 -28.83/-2.41 6 [bos] `` it was beautiful [eos] tgt3: mod/noi/dif/loss/nce/logp -109.33/-27.24 /-82.09 / /-44.85 -7.81 /-1.95 15 [bos] `` it was beautiful . , i said , half to myself . [eos] tgt4: mod/noi/dif/loss/nce/logp -126.50/-12.28 /-114.22/ /-76.98 -18.07/-1.75 8 [bos] `` it was beautiful '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -75.47 /-12.59 /-62.87 / /-25.64 -5.81 /-0.97 14 [bos] `` it was beautiful '' , i said , half to myself [eos] cls0 - sp0 : -16.26 -1.16 15 0.00 [bos] '' it was any '' , i or , ! to i . [eos] cls0 - sp1 : -16.27 -1.16 15 0.00 [bos] she it was any '' , i or , ! to i . [eos] cls0 - sp2 : -16.41 -1.17 15 0.00 [bos] when it was any '' , i or , ! to i . [eos] cls0 - sp3 : -16.87 -1.20 15 0.00 [bos] : it was any '' , i or , ! to i . [eos] cls0 - sp4 : -16.90 -1.21 15 0.00 [bos] '' it was later '' , i or , ! to i . [eos] cls1 - sp0 : -21.66 -1.55 15 0.29 [bos] she it was any '' , i or , ! to i . [eos] cls1 - sp1 : -21.86 -1.56 15 0.29 [bos] she it was any '' , i had , ! to i . [eos] cls1 - sp2 : -21.94 -1.57 15 0.36 [bos] she it was any '' , i or , ! to i . [eos] cls1 - sp3 : -21.97 -1.57 15 0.29 [bos] she it was ! '' , i had , ! to i . [eos] cls1 - sp4 : -22.05 -1.57 15 0.36 [bos] she it was ! '' , i or , ! to i . [eos] cls2 - sp0 : -23.90 -1.71 15 0.50 [bos] she it was ! '' , i had , ! to she . [eos] cls2 - sp1 : -24.58 -1.76 15 0.50 [bos] she it was ! '' , i or , ! to she . [eos] cls2 - sp2 : -24.59 -1.76 15 0.57 [bos] she it was ! '' , i had , ! to she . [eos] cls2 - sp3 : -24.69 -1.76 15 0.64 [bos] she it was ! '' , i had , ! to she . [eos] cls2 - sp4 : -24.87 -1.78 15 0.57 [bos] she it was ! '' , i or , ! to she . [eos] cls3 - sp0 : -18.59 -1.33 15 1.00 [bos] she it was later '' , i life , ! to she . [eos] cls3 - sp1 : -18.61 -1.33 15 1.00 [bos] she it was later '' , i life , ! to i . [eos] cls3 - sp2 : -18.71 -1.34 15 1.00 [bos] she it was life '' , i life , ! to she . [eos] cls3 - sp3 : -18.77 -1.34 15 1.00 [bos] she it was life '' , i life , ! to i . [eos] cls3 - sp4 : -18.80 -1.34 15 1.00 [bos] she it was later '' , i life , ! to all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-98 src: none none 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt0: mod/noi/dif/loss/nce/logp -36.43 /-1.66 /-34.77 /0.69/-0.69 -2.60 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt1: mod/noi/dif/loss/nce/logp -36.43 /-1.66 /-34.77 / /-0.69 -2.60 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt2: mod/noi/dif/loss/nce/logp -149.22/-12.03 /-137.19/ /-103.11 -29.84/-2.41 6 [bos] `` it was beautiful [eos] tgt3: mod/noi/dif/loss/nce/logp -111.03/-27.24 /-83.79 / /-49.71 -7.93 /-1.95 15 [bos] `` it was beautiful . , i said , half to myself . [eos] tgt4: mod/noi/dif/loss/nce/logp -169.81/-12.28 /-157.53/ /-123.45 -24.26/-1.75 8 [bos] `` it was beautiful '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -68.83 /-12.59 /-56.24 / /-22.16 -5.29 /-0.97 14 [bos] `` it was beautiful '' , i said , half to myself [eos] cls0 - sp0 : -16.46 -1.18 15 0.00 [bos] when it was any '' , i or , any to all . [eos] cls0 - sp1 : -16.83 -1.20 15 0.00 [bos] when it was couldn't '' , i or , any to all . [eos] cls0 - sp2 : -16.89 -1.21 15 0.00 [bos] when it was there '' , i or , any to all . [eos] cls0 - sp3 : -16.92 -1.21 15 0.00 [bos] she it was any '' , i or , any to all . [eos] cls0 - sp4 : -16.93 -1.21 15 0.00 [bos] when it was any '' , i or , ! to all . [eos] cls1 - sp0 : -21.43 -1.53 15 0.29 [bos] she it was ! '' , i had , any to all . [eos] cls1 - sp1 : -21.47 -1.53 15 0.36 [bos] she it was ! '' , i had , ! to all . [eos] cls1 - sp2 : -21.48 -1.53 15 0.36 [bos] she it was ! '' , i or , ! to all . [eos] cls1 - sp3 : -21.62 -1.54 15 0.36 [bos] she it was ! '' , i out , ! to all . [eos] cls1 - sp4 : -21.69 -1.55 15 0.29 [bos] she it was couldn't '' , i had , any to all . [eos] cls2 - sp0 : -23.74 -1.70 15 0.50 [bos] she it was ! '' , i out , ! to all . [eos] cls2 - sp1 : -23.99 -1.71 15 0.64 [bos] she it was ! '' , i out , ! to all . [eos] cls2 - sp2 : -24.16 -1.73 15 0.57 [bos] she it was ! '' , i out , ! to all . [eos] cls2 - sp3 : -24.67 -1.76 15 0.50 [bos] she it was ! '' , i out , ! to she . [eos] cls2 - sp4 : -24.76 -1.77 15 0.50 [bos] she it was ! '' , i or , ! to she . [eos] cls3 - sp0 : -16.77 -1.20 15 1.00 [bos] she it was later '' , i life , later to all . [eos] cls3 - sp1 : -17.21 -1.23 15 1.00 [bos] she it was later '' , i out , later to all . [eos] cls3 - sp2 : -17.38 -1.24 15 1.00 [bos] she it was later '' , i life , ! to all . [eos] cls3 - sp3 : -17.52 -1.25 15 1.00 [bos] she it was property '' , i life , later to all . [eos] cls3 - sp4 : -17.53 -1.25 15 1.00 [bos] she it was there '' , i life , later to all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-99 src: none none 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt0: mod/noi/dif/loss/nce/logp -39.81 /-1.66 /-38.15 /0.69/-0.69 -2.84 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt1: mod/noi/dif/loss/nce/logp -39.81 /-1.66 /-38.15 / /-0.69 -2.84 /-0.12 15 [bos] `` it was beautiful '' , i said , half to myself . [eos] tgt2: mod/noi/dif/loss/nce/logp -144.09/-12.03 /-132.06/ /-94.61 -28.82/-2.41 6 [bos] `` it was beautiful [eos] tgt3: mod/noi/dif/loss/nce/logp -111.24/-27.24 /-84.00 / /-46.55 -7.95 /-1.95 15 [bos] `` it was beautiful . , i said , half to myself . [eos] tgt4: mod/noi/dif/loss/nce/logp -139.20/-12.28 /-126.92/ /-89.47 -19.89/-1.75 8 [bos] `` it was beautiful '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -76.27 /-12.59 /-63.68 / /-26.22 -5.87 /-0.97 14 [bos] `` it was beautiful '' , i said , half to myself [eos] cls0 - sp0 : -16.46 -1.18 15 0.00 [bos] when it was any '' , i or , any to all . [eos] cls0 - sp1 : -16.83 -1.20 15 0.00 [bos] when it was couldn't '' , i or , any to all . [eos] cls0 - sp2 : -16.89 -1.21 15 0.00 [bos] when it was there '' , i or , any to all . [eos] cls0 - sp3 : -16.92 -1.21 15 0.00 [bos] she it was any '' , i or , any to all . [eos] cls0 - sp4 : -16.93 -1.21 15 0.00 [bos] when it was any '' , i or , ! to all . [eos] cls1 - sp0 : -21.43 -1.53 15 0.29 [bos] she it was ! '' , i had , any to all . [eos] cls1 - sp1 : -21.47 -1.53 15 0.36 [bos] she it was ! '' , i had , ! to all . [eos] cls1 - sp2 : -21.48 -1.53 15 0.36 [bos] she it was ! '' , i or , ! to all . [eos] cls1 - sp3 : -21.62 -1.54 15 0.36 [bos] she it was ! '' , i out , ! to all . [eos] cls1 - sp4 : -21.69 -1.55 15 0.29 [bos] she it was couldn't '' , i had , any to all . [eos] cls2 - sp0 : -23.74 -1.70 15 0.50 [bos] she it was ! '' , i out , ! to all . [eos] cls2 - sp1 : -23.99 -1.71 15 0.64 [bos] she it was ! '' , i out , ! to all . [eos] cls2 - sp2 : -24.16 -1.73 15 0.57 [bos] she it was ! '' , i out , ! to all . [eos] cls2 - sp3 : -24.67 -1.76 15 0.50 [bos] she it was ! '' , i out , ! to she . [eos] cls2 - sp4 : -24.76 -1.77 15 0.50 [bos] she it was ! '' , i or , ! to she . [eos] cls3 - sp0 : -16.77 -1.20 15 1.00 [bos] she it was later '' , i life , later to all . [eos] cls3 - sp1 : -17.21 -1.23 15 1.00 [bos] she it was later '' , i out , later to all . [eos] cls3 - sp2 : -17.38 -1.24 15 1.00 [bos] she it was later '' , i life , ! to all . [eos] cls3 - sp3 : -17.52 -1.25 15 1.00 [bos] she it was property '' , i life , later to all . [eos] cls3 - sp4 : -17.53 -1.25 15 1.00 [bos] she it was there '' , i life , later to all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-100 src: none none 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt0: mod/noi/dif/loss/nce/logp -73.17 /-0.85 /-72.32 /0.69/-0.69 -7.32 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt1: mod/noi/dif/loss/nce/logp -73.17 /-0.85 /-72.32 / /-0.69 -7.32 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt2: mod/noi/dif/loss/nce/logp -96.09 /-11.84 /-84.25 / /-12.63 -10.68/-1.32 10 [bos] cady partlow lit his pipe with no comfort [eos] tgt3: mod/noi/dif/loss/nce/logp -94.72 /-12.73 /-81.99 / /-10.37 -9.47 /-1.27 11 [bos] cady partlow lit fifty pipe with no comfort . [eos] tgt4: mod/noi/dif/loss/nce/logp -113.04/-12.04 /-101.00/ /-29.38 -10.28/-1.09 12 [bos] cady partlow lit his pipe with no comfort . . [eos] tgt5: mod/noi/dif/loss/nce/logp -93.14 /-11.51 /-81.63 / /-10.01 -9.31 /-1.15 11 [bos] cady partlow lit his pipe of no comfort . [eos] cls0 - sp0 : -15.24 -3.05 6 0.20 [bos] she dr. ! his [eos] cls0 - sp1 : -16.71 -3.34 6 0.20 [bos] she dr. ! a [eos] cls0 - sp2 : -16.80 -3.36 6 0.20 [bos] she joined ! a [eos] cls0 - sp3 : -16.95 -3.39 6 0.20 [bos] ! ! ! his [eos] cls0 - sp4 : -17.05 -3.41 6 0.20 [bos] she pain ! a [eos] cls1 - sp0 : -15.80 -3.16 6 0.40 [bos] ! ! ! his [eos] cls1 - sp1 : -16.00 -3.20 6 0.40 [bos] ! ! ! his [eos] cls1 - sp2 : -16.56 -3.31 6 0.40 [bos] ! ! ! a [eos] cls1 - sp3 : -16.57 -3.31 6 0.40 [bos] ! ! ! his [eos] cls1 - sp4 : -16.70 -3.34 6 0.40 [bos] ! ! ! a [eos] cls2 - sp0 : -14.83 -2.97 6 0.60 [bos] ! ! ! his [eos] cls2 - sp1 : -15.23 -3.05 6 0.60 [bos] ! ! ! a [eos] cls2 - sp2 : -15.44 -3.09 6 0.60 [bos] ! ! ; his [eos] cls2 - sp3 : -16.32 -3.26 6 0.60 [bos] ! ! ; a [eos] cls2 - sp4 : -21.04 -2.10 11 0.70 [bos] ! ! ! his ! with no ! . [eos] cls3 - sp0 : -15.27 -3.05 6 0.80 [bos] ! ! ! a [eos] cls3 - sp1 : -20.54 -2.05 11 0.90 [bos] ! ! ! his ! with no ! . [eos] cls3 - sp2 : -20.56 -2.06 11 0.90 [bos] ! ! ! a ! with no ! . [eos] cls3 - sp3 : -20.60 -2.06 11 1.00 [bos] ! ! ! a ! with no ! . [eos] cls3 - sp4 : -20.67 -2.07 11 1.00 [bos] ! ! ! his ! with no ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-101 src: none none 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt0: mod/noi/dif/loss/nce/logp -73.58 /-0.85 /-72.72 /0.69/-0.69 -7.36 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt1: mod/noi/dif/loss/nce/logp -73.58 /-0.85 /-72.72 / /-0.69 -7.36 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt2: mod/noi/dif/loss/nce/logp -103.61/-11.84 /-91.77 / /-19.74 -11.51/-1.32 10 [bos] cady partlow lit his pipe with no comfort [eos] tgt3: mod/noi/dif/loss/nce/logp -99.87 /-12.73 /-87.14 / /-15.11 -9.99 /-1.27 11 [bos] cady partlow lit fifty pipe with no comfort . [eos] tgt4: mod/noi/dif/loss/nce/logp -113.65/-12.04 /-101.61/ /-29.58 -10.33/-1.09 12 [bos] cady partlow lit his pipe with no comfort . . [eos] tgt5: mod/noi/dif/loss/nce/logp -94.79 /-11.51 /-83.29 / /-11.26 -9.48 /-1.15 11 [bos] cady partlow lit his pipe of no comfort . [eos] cls0 - sp0 : -15.24 -3.05 6 0.20 [bos] she dr. ! his [eos] cls0 - sp1 : -16.71 -3.34 6 0.20 [bos] she dr. ! a [eos] cls0 - sp2 : -16.80 -3.36 6 0.20 [bos] she joined ! a [eos] cls0 - sp3 : -16.95 -3.39 6 0.20 [bos] ! ! ! his [eos] cls0 - sp4 : -17.05 -3.41 6 0.20 [bos] she pain ! a [eos] cls1 - sp0 : -15.80 -3.16 6 0.40 [bos] ! ! ! his [eos] cls1 - sp1 : -16.00 -3.20 6 0.40 [bos] ! ! ! his [eos] cls1 - sp2 : -16.56 -3.31 6 0.40 [bos] ! ! ! a [eos] cls1 - sp3 : -16.57 -3.31 6 0.40 [bos] ! ! ! his [eos] cls1 - sp4 : -16.70 -3.34 6 0.40 [bos] ! ! ! a [eos] cls2 - sp0 : -14.83 -2.97 6 0.60 [bos] ! ! ! his [eos] cls2 - sp1 : -15.23 -3.05 6 0.60 [bos] ! ! ! a [eos] cls2 - sp2 : -15.44 -3.09 6 0.60 [bos] ! ! ; his [eos] cls2 - sp3 : -16.32 -3.26 6 0.60 [bos] ! ! ; a [eos] cls2 - sp4 : -21.04 -2.10 11 0.70 [bos] ! ! ! his ! with no ! . [eos] cls3 - sp0 : -15.27 -3.05 6 0.80 [bos] ! ! ! a [eos] cls3 - sp1 : -20.54 -2.05 11 0.90 [bos] ! ! ! his ! with no ! . [eos] cls3 - sp2 : -20.56 -2.06 11 0.90 [bos] ! ! ! a ! with no ! . [eos] cls3 - sp3 : -20.60 -2.06 11 1.00 [bos] ! ! ! a ! with no ! . [eos] cls3 - sp4 : -20.67 -2.07 11 1.00 [bos] ! ! ! his ! with no ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-102 src: none none 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt0: mod/noi/dif/loss/nce/logp -76.20 /-0.85 /-75.34 /0.69/-0.69 -7.62 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt1: mod/noi/dif/loss/nce/logp -76.20 /-0.85 /-75.34 / /-0.69 -7.62 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt2: mod/noi/dif/loss/nce/logp -96.36 /-11.84 /-84.53 / /-9.88 -10.71/-1.32 10 [bos] cady partlow lit his pipe with no comfort [eos] tgt3: mod/noi/dif/loss/nce/logp -96.99 /-12.73 /-84.26 / /-9.61 -9.70 /-1.27 11 [bos] cady partlow lit fifty pipe with no comfort . [eos] tgt4: mod/noi/dif/loss/nce/logp -113.24/-12.04 /-101.20/ /-26.55 -10.29/-1.09 12 [bos] cady partlow lit his pipe with no comfort . . [eos] tgt5: mod/noi/dif/loss/nce/logp -95.27 /-11.51 /-83.76 / /-9.12 -9.53 /-1.15 11 [bos] cady partlow lit his pipe of no comfort . [eos] cls0 - sp0 : -14.49 -2.41 7 0.17 [bos] ! ! ! his ! [eos] cls0 - sp1 : -15.48 -2.58 7 0.00 [bos] ! ! ! his ! [eos] cls0 - sp2 : -15.86 -2.64 7 0.00 [bos] ! ! ! a ! [eos] cls0 - sp3 : -15.87 -2.65 7 0.17 [bos] ! ! ! his ! [eos] cls0 - sp4 : -15.99 -2.67 7 0.17 [bos] ! ! ! a ! [eos] cls1 - sp0 : -14.39 -2.40 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp1 : -15.07 -2.51 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp2 : -15.07 -2.51 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp3 : -16.37 -2.73 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp4 : -19.04 -1.90 11 0.40 [bos] ! ! ! his ! with ! ! . [eos] cls2 - sp0 : -14.38 -2.40 7 0.67 [bos] ! ! ! his ! [eos] cls2 - sp1 : -14.42 -2.40 7 0.50 [bos] ! ! ! his ! [eos] cls2 - sp2 : -17.34 -1.93 10 0.67 [bos] ! ! ! his ! ! ! ! [eos] cls2 - sp3 : -17.62 -1.96 10 0.67 [bos] ! ! ! his ! ! ! ! [eos] cls2 - sp4 : -17.95 -1.99 10 0.56 [bos] ! ! ! his ! ! ! ! [eos] cls3 - sp0 : -16.00 -1.78 10 0.89 [bos] ! ! ! his ! ! ! ! [eos] cls3 - sp1 : -16.49 -1.83 10 0.78 [bos] ! ! ! his ! ! ! ! [eos] cls3 - sp2 : -17.05 -1.71 11 0.90 [bos] ! ! ! his ! with ! ! . [eos] cls3 - sp3 : -17.45 -1.74 11 1.00 [bos] ! ! ! his ! with ! ! . [eos] cls3 - sp4 : -17.57 -1.95 10 0.78 [bos] ! ! ! his ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-103 src: none none 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt0: mod/noi/dif/loss/nce/logp -77.48 /-0.85 /-76.62 /0.69/-0.69 -7.75 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt1: mod/noi/dif/loss/nce/logp -77.48 /-0.85 /-76.62 / /-0.69 -7.75 /-0.09 11 [bos] cady partlow lit his pipe with no comfort . [eos] tgt2: mod/noi/dif/loss/nce/logp -103.91/-11.84 /-92.07 / /-16.13 -11.55/-1.32 10 [bos] cady partlow lit his pipe with no comfort [eos] tgt3: mod/noi/dif/loss/nce/logp -103.10/-12.73 /-90.38 / /-14.44 -10.31/-1.27 11 [bos] cady partlow lit fifty pipe with no comfort . [eos] tgt4: mod/noi/dif/loss/nce/logp -115.69/-12.04 /-103.65/ /-27.71 -10.52/-1.09 12 [bos] cady partlow lit his pipe with no comfort . . [eos] tgt5: mod/noi/dif/loss/nce/logp -97.63 /-11.51 /-86.12 / /-10.19 -9.76 /-1.15 11 [bos] cady partlow lit his pipe of no comfort . [eos] cls0 - sp0 : -14.49 -2.41 7 0.17 [bos] ! ! ! his ! [eos] cls0 - sp1 : -15.48 -2.58 7 0.00 [bos] ! ! ! his ! [eos] cls0 - sp2 : -15.86 -2.64 7 0.00 [bos] ! ! ! a ! [eos] cls0 - sp3 : -15.87 -2.65 7 0.17 [bos] ! ! ! his ! [eos] cls0 - sp4 : -15.99 -2.67 7 0.17 [bos] ! ! ! a ! [eos] cls1 - sp0 : -14.39 -2.40 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp1 : -15.07 -2.51 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp2 : -15.07 -2.51 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp3 : -16.37 -2.73 7 0.33 [bos] ! ! ! his ! [eos] cls1 - sp4 : -19.04 -1.90 11 0.40 [bos] ! ! ! his ! with ! ! . [eos] cls2 - sp0 : -14.38 -2.40 7 0.67 [bos] ! ! ! his ! [eos] cls2 - sp1 : -14.42 -2.40 7 0.50 [bos] ! ! ! his ! [eos] cls2 - sp2 : -17.34 -1.93 10 0.67 [bos] ! ! ! his ! ! ! ! [eos] cls2 - sp3 : -17.62 -1.96 10 0.67 [bos] ! ! ! his ! ! ! ! [eos] cls2 - sp4 : -17.95 -1.99 10 0.56 [bos] ! ! ! his ! ! ! ! [eos] cls3 - sp0 : -16.00 -1.78 10 0.89 [bos] ! ! ! his ! ! ! ! [eos] cls3 - sp1 : -16.49 -1.83 10 0.78 [bos] ! ! ! his ! ! ! ! [eos] cls3 - sp2 : -17.05 -1.71 11 0.90 [bos] ! ! ! his ! with ! ! . [eos] cls3 - sp3 : -17.45 -1.74 11 1.00 [bos] ! ! ! his ! with ! ! . [eos] cls3 - sp4 : -17.57 -1.95 10 0.78 [bos] ! ! ! his ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-104 src: none none 7 [bos] gone back for [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -23.74 /-0.73 /-23.01 /0.69/-0.69 -3.96 /-0.12 7 [bos] gone back for [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -23.74 /-0.73 /-23.01 / /-0.69 -3.96 /-0.12 7 [bos] gone back for [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -54.29 /-11.60 /-42.69 / /-20.37 -10.86/-2.32 6 [bos] gone back for [unk] [eos] tgt3: mod/noi/dif/loss/nce/logp -57.66 /-11.79 /-45.87 / /-23.55 -8.24 /-1.68 8 [bos] gone back for [unk] . . [eos] tgt4: mod/noi/dif/loss/nce/logp -45.21 /-11.69 /-33.52 / /-11.20 -7.54 /-1.95 7 [bos] gone back , [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -130.59/-11.85 /-118.74/ /-96.42 -43.53/-3.95 4 [bos] gone back [eos] cls0 - sp0 : -8.11 -1.62 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -8.33 -1.39 7 0.00 [bos] i no for [unk] . [eos] cls0 - sp2 : -8.68 -1.45 7 0.17 [bos] ! no for [unk] . [eos] cls0 - sp3 : -8.74 -1.46 7 0.00 [bos] i no for its . [eos] cls0 - sp4 : -8.77 -1.46 7 0.00 [bos] she no for [unk] . [eos] cls1 - sp0 : -7.45 -1.49 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -8.63 -1.44 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp2 : -9.53 -1.91 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -9.64 -1.61 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp4 : -9.67 -1.61 7 0.33 [bos] ! ! ! ( . [eos] cls2 - sp0 : -8.44 -1.41 7 0.50 [bos] ! ! ! ; ! [eos] cls2 - sp1 : -8.55 -1.42 7 0.67 [bos] ! ! ! ; ! [eos] cls2 - sp2 : -8.57 -1.71 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -8.96 -1.49 7 0.67 [bos] ! ! ! ! ! [eos] cls2 - sp4 : -9.07 -1.51 7 0.50 [bos] ! ! ! ; ! [eos] cls3 - sp0 : -8.64 -1.44 7 0.83 [bos] ! no for ( . [eos] cls3 - sp1 : -9.04 -1.51 7 0.83 [bos] ! ! ! ! ! [eos] cls3 - sp2 : -9.04 -1.51 7 0.83 [bos] we no for ( . [eos] cls3 - sp3 : -9.10 -1.52 7 0.83 [bos] she no for ( . [eos] cls3 - sp4 : -9.22 -1.54 7 0.83 [bos] ! ) for ( . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-105 src: none none 7 [bos] gone back for [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -29.02 /-0.73 /-28.29 /0.69/-0.69 -4.84 /-0.12 7 [bos] gone back for [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -29.02 /-0.73 /-28.29 / /-0.69 -4.84 /-0.12 7 [bos] gone back for [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -60.21 /-11.60 /-48.61 / /-21.01 -12.04/-2.32 6 [bos] gone back for [unk] [eos] tgt3: mod/noi/dif/loss/nce/logp -64.82 /-11.79 /-53.04 / /-25.44 -9.26 /-1.68 8 [bos] gone back for [unk] . . [eos] tgt4: mod/noi/dif/loss/nce/logp -53.12 /-11.69 /-41.43 / /-13.83 -8.85 /-1.95 7 [bos] gone back , [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -118.76/-11.85 /-106.91/ /-79.31 -39.59/-3.95 4 [bos] gone back [eos] cls0 - sp0 : -8.11 -1.62 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -8.33 -1.39 7 0.00 [bos] i no for [unk] . [eos] cls0 - sp2 : -8.68 -1.45 7 0.17 [bos] ! no for [unk] . [eos] cls0 - sp3 : -8.74 -1.46 7 0.00 [bos] i no for its . [eos] cls0 - sp4 : -8.77 -1.46 7 0.00 [bos] she no for [unk] . [eos] cls1 - sp0 : -7.45 -1.49 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -8.63 -1.44 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp2 : -9.53 -1.91 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -9.64 -1.61 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp4 : -9.67 -1.61 7 0.33 [bos] ! ! ! ( . [eos] cls2 - sp0 : -8.44 -1.41 7 0.50 [bos] ! ! ! ; ! [eos] cls2 - sp1 : -8.55 -1.42 7 0.67 [bos] ! ! ! ; ! [eos] cls2 - sp2 : -8.57 -1.71 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -8.96 -1.49 7 0.67 [bos] ! ! ! ! ! [eos] cls2 - sp4 : -9.07 -1.51 7 0.50 [bos] ! ! ! ; ! [eos] cls3 - sp0 : -8.64 -1.44 7 0.83 [bos] ! no for ( . [eos] cls3 - sp1 : -9.04 -1.51 7 0.83 [bos] ! ! ! ! ! [eos] cls3 - sp2 : -9.04 -1.51 7 0.83 [bos] we no for ( . [eos] cls3 - sp3 : -9.10 -1.52 7 0.83 [bos] she no for ( . [eos] cls3 - sp4 : -9.22 -1.54 7 0.83 [bos] ! ) for ( . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-106 src: none none 7 [bos] gone back for [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -22.84 /-0.73 /-22.11 /0.69/-0.69 -3.81 /-0.12 7 [bos] gone back for [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -22.84 /-0.73 /-22.11 / /-0.69 -3.81 /-0.12 7 [bos] gone back for [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -54.66 /-11.60 /-43.07 / /-21.65 -10.93/-2.32 6 [bos] gone back for [unk] [eos] tgt3: mod/noi/dif/loss/nce/logp -55.06 /-11.79 /-43.27 / /-21.85 -7.87 /-1.68 8 [bos] gone back for [unk] . . [eos] tgt4: mod/noi/dif/loss/nce/logp -43.11 /-11.69 /-31.42 / /-10.00 -7.18 /-1.95 7 [bos] gone back , [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -121.44/-11.85 /-109.59/ /-88.17 -40.48/-3.95 4 [bos] gone back [eos] cls0 - sp0 : -7.10 -1.18 7 0.00 [bos] she no as [unk] . [eos] cls0 - sp1 : -7.24 -1.21 7 0.00 [bos] she no for [unk] . [eos] cls0 - sp2 : -7.40 -1.23 7 0.00 [bos] i no for [unk] . [eos] cls0 - sp3 : -7.57 -1.26 7 0.00 [bos] she no this [unk] . [eos] cls0 - sp4 : -7.84 -1.31 7 0.00 [bos] she any for [unk] . [eos] cls1 - sp0 : -7.79 -1.56 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -9.31 -1.86 6 0.40 [bos] ! ! ! ; [eos] cls1 - sp2 : -9.33 -1.56 7 0.33 [bos] ! no this [unk] . [eos] cls1 - sp3 : -9.65 -1.93 6 0.40 [bos] ! no ! ! [eos] cls1 - sp4 : -9.79 -1.63 7 0.33 [bos] ! ! ! ; ! [eos] cls2 - sp0 : -9.34 -1.87 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -9.77 -1.63 7 0.50 [bos] ! ! ! ; ! [eos] cls2 - sp2 : -9.92 -1.65 7 0.67 [bos] ! ! ! ! ! [eos] cls2 - sp3 : -9.97 -1.66 7 0.67 [bos] ! ! ! ! ! [eos] cls2 - sp4 : -10.19 -1.70 7 0.50 [bos] ! ! ! ; ! [eos] cls3 - sp0 : -7.45 -1.24 7 0.83 [bos] she no for [unk] . [eos] cls3 - sp1 : -8.13 -1.35 7 0.83 [bos] we no for [unk] . [eos] cls3 - sp2 : -8.15 -1.36 7 0.83 [bos] she made for [unk] . [eos] cls3 - sp3 : -8.55 -1.42 7 0.83 [bos] she life for [unk] . [eos] cls3 - sp4 : -8.59 -1.43 7 0.83 [bos] she no this [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-107 src: none none 7 [bos] gone back for [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -28.21 /-0.73 /-27.48 /0.69/-0.69 -4.70 /-0.12 7 [bos] gone back for [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -28.21 /-0.73 /-27.48 / /-0.69 -4.70 /-0.12 7 [bos] gone back for [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -60.45 /-11.60 /-48.86 / /-22.07 -12.09/-2.32 6 [bos] gone back for [unk] [eos] tgt3: mod/noi/dif/loss/nce/logp -63.23 /-11.79 /-51.44 / /-24.65 -9.03 /-1.68 8 [bos] gone back for [unk] . . [eos] tgt4: mod/noi/dif/loss/nce/logp -52.43 /-11.69 /-40.74 / /-13.95 -8.74 /-1.95 7 [bos] gone back , [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -113.30/-11.85 /-101.46/ /-74.66 -37.77/-3.95 4 [bos] gone back [eos] cls0 - sp0 : -7.10 -1.18 7 0.00 [bos] she no as [unk] . [eos] cls0 - sp1 : -7.24 -1.21 7 0.00 [bos] she no for [unk] . [eos] cls0 - sp2 : -7.40 -1.23 7 0.00 [bos] i no for [unk] . [eos] cls0 - sp3 : -7.57 -1.26 7 0.00 [bos] she no this [unk] . [eos] cls0 - sp4 : -7.84 -1.31 7 0.00 [bos] she any for [unk] . [eos] cls1 - sp0 : -7.79 -1.56 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -9.31 -1.86 6 0.40 [bos] ! ! ! ; [eos] cls1 - sp2 : -9.33 -1.56 7 0.33 [bos] ! no this [unk] . [eos] cls1 - sp3 : -9.65 -1.93 6 0.40 [bos] ! no ! ! [eos] cls1 - sp4 : -9.79 -1.63 7 0.33 [bos] ! ! ! ; ! [eos] cls2 - sp0 : -9.34 -1.87 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -9.77 -1.63 7 0.50 [bos] ! ! ! ; ! [eos] cls2 - sp2 : -9.92 -1.65 7 0.67 [bos] ! ! ! ! ! [eos] cls2 - sp3 : -9.97 -1.66 7 0.67 [bos] ! ! ! ! ! [eos] cls2 - sp4 : -10.19 -1.70 7 0.50 [bos] ! ! ! ; ! [eos] cls3 - sp0 : -7.45 -1.24 7 0.83 [bos] she no for [unk] . [eos] cls3 - sp1 : -8.13 -1.35 7 0.83 [bos] we no for [unk] . [eos] cls3 - sp2 : -8.15 -1.36 7 0.83 [bos] she made for [unk] . [eos] cls3 - sp3 : -8.55 -1.42 7 0.83 [bos] she life for [unk] . [eos] cls3 - sp4 : -8.59 -1.43 7 0.83 [bos] she no this [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-108 src: none none 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt0: mod/noi/dif/loss/nce/logp -102.53/-1.67 /-100.85/0.69/-0.69 -6.03 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt1: mod/noi/dif/loss/nce/logp -102.53/-1.67 /-100.85/ /-0.69 -6.03 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt2: mod/noi/dif/loss/nce/logp -140.44/-12.62 /-127.81/ /-27.65 -8.78 /-0.79 17 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years [eos] tgt3: mod/noi/dif/loss/nce/logp -126.59/-12.73 /-113.86/ /-13.70 -7.45 /-0.75 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game of fifteen years . [eos] tgt4: mod/noi/dif/loss/nce/logp -127.40/-12.77 /-114.63/ /-14.47 -7.49 /-0.75 18 [bos] look at pete [unk] , who hadn't missed the hanford ball game in fifteen years . [eos] tgt5: mod/noi/dif/loss/nce/logp -139.03/-12.78 /-126.25/ /-26.09 -7.72 /-0.71 19 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . . [eos] cls0 - sp0 : -23.87 -1.99 13 0.00 [bos] she at first [unk] , who i joined a joined ! [eos] cls0 - sp1 : -27.05 -2.25 13 0.08 [bos] she at first [unk] , who i joined a joined no [eos] cls0 - sp2 : -27.30 -2.27 13 0.08 [bos] she at first [unk] , who i no a joined no [eos] cls0 - sp3 : -27.33 -2.28 13 0.08 [bos] she at first [unk] , who i mean a joined no [eos] cls0 - sp4 : -27.34 -2.28 13 0.08 [bos] she at first [unk] , who when joined a joined no [eos] cls1 - sp0 : -26.15 -2.18 13 0.42 [bos] ! at couldn't [unk] , who ! ! a ! ! [eos] cls1 - sp1 : -26.19 -2.18 13 0.33 [bos] ! at couldn't [unk] , who ! ! a ! ! [eos] cls1 - sp2 : -26.74 -2.23 13 0.42 [bos] ! at couldn't [unk] , who ! don't a ! ! [eos] cls1 - sp3 : -26.84 -2.24 13 0.42 [bos] ! at couldn't [unk] , who ! ! a joined ! [eos] cls1 - sp4 : -26.85 -2.24 13 0.33 [bos] ! at couldn't [unk] , who ! ! a joined ! [eos] cls2 - sp0 : -24.17 -2.20 12 0.73 [bos] ! at first [unk] , but ! ! a ! [eos] cls2 - sp1 : -25.67 -2.14 13 0.67 [bos] ! at first [unk] , but ! ! a discussed ! [eos] cls2 - sp2 : -26.23 -2.19 13 0.67 [bos] ! at first [unk] , but ! ! a telephone ! [eos] cls2 - sp3 : -26.30 -2.19 13 0.67 [bos] ! at first [unk] , but ! ! a corner ! [eos] cls2 - sp4 : -26.59 -2.22 13 0.67 [bos] ! at first [unk] , who ! ! a discussed ! [eos] cls3 - sp0 : -26.85 -2.24 13 0.92 [bos] she at first [unk] , but ! later a corner ! [eos] cls3 - sp1 : -26.88 -2.24 13 0.75 [bos] ! at first [unk] , but ! ! a discussed ! [eos] cls3 - sp2 : -27.70 -2.31 13 0.75 [bos] ! at first [unk] , who ! ! a discussed ! [eos] cls3 - sp3 : -27.71 -2.31 13 0.75 [bos] ! at first [unk] , but ! ! a telephone ! [eos] cls3 - sp4 : -28.13 -2.34 13 0.75 [bos] ! at first [unk] , but ! ! a telephone ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-109 src: none none 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt0: mod/noi/dif/loss/nce/logp -99.13 /-1.67 /-97.46 /0.69/-0.69 -5.83 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt1: mod/noi/dif/loss/nce/logp -99.13 /-1.67 /-97.46 / /-0.69 -5.83 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt2: mod/noi/dif/loss/nce/logp -139.57/-12.62 /-126.94/ /-30.18 -8.72 /-0.79 17 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years [eos] tgt3: mod/noi/dif/loss/nce/logp -122.64/-12.73 /-109.91/ /-13.15 -7.21 /-0.75 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game of fifteen years . [eos] tgt4: mod/noi/dif/loss/nce/logp -123.47/-12.77 /-110.70/ /-13.94 -7.26 /-0.75 18 [bos] look at pete [unk] , who hadn't missed the hanford ball game in fifteen years . [eos] tgt5: mod/noi/dif/loss/nce/logp -136.79/-12.78 /-124.01/ /-27.25 -7.60 /-0.71 19 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . . [eos] cls0 - sp0 : -23.87 -1.99 13 0.00 [bos] she at first [unk] , who i joined a joined ! [eos] cls0 - sp1 : -27.05 -2.25 13 0.08 [bos] she at first [unk] , who i joined a joined no [eos] cls0 - sp2 : -27.30 -2.27 13 0.08 [bos] she at first [unk] , who i no a joined no [eos] cls0 - sp3 : -27.33 -2.28 13 0.08 [bos] she at first [unk] , who i mean a joined no [eos] cls0 - sp4 : -27.34 -2.28 13 0.08 [bos] she at first [unk] , who when joined a joined no [eos] cls1 - sp0 : -26.15 -2.18 13 0.42 [bos] ! at couldn't [unk] , who ! ! a ! ! [eos] cls1 - sp1 : -26.19 -2.18 13 0.33 [bos] ! at couldn't [unk] , who ! ! a ! ! [eos] cls1 - sp2 : -26.74 -2.23 13 0.42 [bos] ! at couldn't [unk] , who ! don't a ! ! [eos] cls1 - sp3 : -26.84 -2.24 13 0.42 [bos] ! at couldn't [unk] , who ! ! a joined ! [eos] cls1 - sp4 : -26.85 -2.24 13 0.33 [bos] ! at couldn't [unk] , who ! ! a joined ! [eos] cls2 - sp0 : -24.17 -2.20 12 0.73 [bos] ! at first [unk] , but ! ! a ! [eos] cls2 - sp1 : -25.67 -2.14 13 0.67 [bos] ! at first [unk] , but ! ! a discussed ! [eos] cls2 - sp2 : -26.23 -2.19 13 0.67 [bos] ! at first [unk] , but ! ! a telephone ! [eos] cls2 - sp3 : -26.30 -2.19 13 0.67 [bos] ! at first [unk] , but ! ! a corner ! [eos] cls2 - sp4 : -26.59 -2.22 13 0.67 [bos] ! at first [unk] , who ! ! a discussed ! [eos] cls3 - sp0 : -26.85 -2.24 13 0.92 [bos] she at first [unk] , but ! later a corner ! [eos] cls3 - sp1 : -26.88 -2.24 13 0.75 [bos] ! at first [unk] , but ! ! a discussed ! [eos] cls3 - sp2 : -27.70 -2.31 13 0.75 [bos] ! at first [unk] , who ! ! a discussed ! [eos] cls3 - sp3 : -27.71 -2.31 13 0.75 [bos] ! at first [unk] , but ! ! a telephone ! [eos] cls3 - sp4 : -28.13 -2.34 13 0.75 [bos] ! at first [unk] , but ! ! a telephone ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-110 src: none none 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt0: mod/noi/dif/loss/nce/logp -105.06/-1.67 /-103.39/0.69/-0.69 -6.18 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt1: mod/noi/dif/loss/nce/logp -105.06/-1.67 /-103.39/ /-0.69 -6.18 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt2: mod/noi/dif/loss/nce/logp -142.15/-12.62 /-129.52/ /-26.83 -8.88 /-0.79 17 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years [eos] tgt3: mod/noi/dif/loss/nce/logp -129.44/-12.73 /-116.72/ /-14.02 -7.61 /-0.75 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game of fifteen years . [eos] tgt4: mod/noi/dif/loss/nce/logp -129.48/-12.77 /-116.71/ /-14.01 -7.62 /-0.75 18 [bos] look at pete [unk] , who hadn't missed the hanford ball game in fifteen years . [eos] tgt5: mod/noi/dif/loss/nce/logp -140.43/-12.78 /-127.65/ /-24.95 -7.80 /-0.71 19 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . . [eos] cls0 - sp0 : -28.21 -2.35 13 0.00 [bos] we at later [unk] , who first any a joined joined [eos] cls0 - sp1 : -28.27 -2.36 13 0.00 [bos] she at couldn't [unk] , who first any a joined joined [eos] cls0 - sp2 : -28.34 -2.36 13 0.00 [bos] she at later [unk] , who first any a joined joined [eos] cls0 - sp3 : -28.51 -2.38 13 0.08 [bos] she at couldn't [unk] , who first any a joined joined [eos] cls0 - sp4 : -28.51 -2.38 13 0.08 [bos] she at later [unk] , who first any a joined joined [eos] cls1 - sp0 : -32.11 -2.68 13 0.42 [bos] she at don't [unk] , who first any a telephone corner [eos] cls1 - sp1 : -32.36 -2.70 13 0.33 [bos] she at couldn't [unk] , who she ( a joined couldn't [eos] cls1 - sp2 : -32.40 -2.70 13 0.25 [bos] ! at couldn't [unk] , who first any a joined couldn't [eos] cls1 - sp3 : -32.56 -2.71 13 0.42 [bos] she at don't [unk] , who first any a telephone discussed [eos] cls1 - sp4 : -32.99 -2.75 13 0.25 [bos] ! at couldn't [unk] , who all any a joined couldn't [eos] cls2 - sp0 : -31.56 -2.63 13 0.67 [bos] she at couldn't [unk] , who she personal a corner corner [eos] cls2 - sp1 : -33.60 -2.80 13 0.67 [bos] she at couldn't [unk] , who she personal a corner discussed [eos] cls2 - sp2 : -33.87 -2.82 13 0.67 [bos] she at couldn't [unk] , who she personal a telephone corner [eos] cls2 - sp3 : -33.97 -2.83 13 0.67 [bos] she at couldn't [unk] , who she space a telephone corner [eos] cls2 - sp4 : -35.35 -2.95 13 0.50 [bos] she at don't [unk] , who first any a telephone corner [eos] cls3 - sp0 : -36.56 -2.15 18 1.00 [bos] she at later [unk] , who first personal a corner corner discussed in all about . [eos] cls3 - sp1 : -36.59 -2.15 18 1.00 [bos] she at later [unk] , who first personal a corner made crime in all about . [eos] cls3 - sp2 : -36.60 -2.15 18 1.00 [bos] she at later [unk] , who first personal a corner made discussed in all about . [eos] cls3 - sp3 : -36.66 -2.16 18 1.00 [bos] she at later [unk] , who all personal a corner corner discussed in all about . [eos] cls3 - sp4 : -36.68 -2.16 18 1.00 [bos] she at later [unk] , who first personal a telephone made crime in all about . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-111 src: none none 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt0: mod/noi/dif/loss/nce/logp -99.40 /-1.67 /-97.73 /0.69/-0.69 -5.85 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt1: mod/noi/dif/loss/nce/logp -99.40 /-1.67 /-97.73 / /-0.69 -5.85 /-0.10 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . [eos] tgt2: mod/noi/dif/loss/nce/logp -139.35/-12.62 /-126.72/ /-29.69 -8.71 /-0.79 17 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years [eos] tgt3: mod/noi/dif/loss/nce/logp -122.95/-12.73 /-110.22/ /-13.18 -7.23 /-0.75 18 [bos] look at pete [unk] , who hadn't missed a hanford ball game of fifteen years . [eos] tgt4: mod/noi/dif/loss/nce/logp -123.65/-12.77 /-110.88/ /-13.84 -7.27 /-0.75 18 [bos] look at pete [unk] , who hadn't missed the hanford ball game in fifteen years . [eos] tgt5: mod/noi/dif/loss/nce/logp -136.56/-12.78 /-123.78/ /-26.74 -7.59 /-0.71 19 [bos] look at pete [unk] , who hadn't missed a hanford ball game in fifteen years . . [eos] cls0 - sp0 : -28.21 -2.35 13 0.00 [bos] we at later [unk] , who first any a joined joined [eos] cls0 - sp1 : -28.27 -2.36 13 0.00 [bos] she at couldn't [unk] , who first any a joined joined [eos] cls0 - sp2 : -28.34 -2.36 13 0.00 [bos] she at later [unk] , who first any a joined joined [eos] cls0 - sp3 : -28.51 -2.38 13 0.08 [bos] she at couldn't [unk] , who first any a joined joined [eos] cls0 - sp4 : -28.51 -2.38 13 0.08 [bos] she at later [unk] , who first any a joined joined [eos] cls1 - sp0 : -32.11 -2.68 13 0.42 [bos] she at don't [unk] , who first any a telephone corner [eos] cls1 - sp1 : -32.36 -2.70 13 0.33 [bos] she at couldn't [unk] , who she ( a joined couldn't [eos] cls1 - sp2 : -32.40 -2.70 13 0.25 [bos] ! at couldn't [unk] , who first any a joined couldn't [eos] cls1 - sp3 : -32.56 -2.71 13 0.42 [bos] she at don't [unk] , who first any a telephone discussed [eos] cls1 - sp4 : -32.99 -2.75 13 0.25 [bos] ! at couldn't [unk] , who all any a joined couldn't [eos] cls2 - sp0 : -31.56 -2.63 13 0.67 [bos] she at couldn't [unk] , who she personal a corner corner [eos] cls2 - sp1 : -33.60 -2.80 13 0.67 [bos] she at couldn't [unk] , who she personal a corner discussed [eos] cls2 - sp2 : -33.87 -2.82 13 0.67 [bos] she at couldn't [unk] , who she personal a telephone corner [eos] cls2 - sp3 : -33.97 -2.83 13 0.67 [bos] she at couldn't [unk] , who she space a telephone corner [eos] cls2 - sp4 : -35.35 -2.95 13 0.50 [bos] she at don't [unk] , who first any a telephone corner [eos] cls3 - sp0 : -36.56 -2.15 18 1.00 [bos] she at later [unk] , who first personal a corner corner discussed in all about . [eos] cls3 - sp1 : -36.59 -2.15 18 1.00 [bos] she at later [unk] , who first personal a corner made crime in all about . [eos] cls3 - sp2 : -36.60 -2.15 18 1.00 [bos] she at later [unk] , who first personal a corner made discussed in all about . [eos] cls3 - sp3 : -36.66 -2.16 18 1.00 [bos] she at later [unk] , who all personal a corner corner discussed in all about . [eos] cls3 - sp4 : -36.68 -2.16 18 1.00 [bos] she at later [unk] , who first personal a telephone made crime in all about . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-112 src: none none 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt0: mod/noi/dif/loss/nce/logp -155.41/-2.80 /-152.61/0.69/-0.69 -5.36 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt1: mod/noi/dif/loss/nce/logp -155.41/-2.80 /-152.61/ /-0.69 -5.36 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt2: mod/noi/dif/loss/nce/logp -182.40/-14.65 /-167.75/ /-15.83 -6.29 /-0.51 30 [bos] mr. partlow could still feel a cold sweat on fifty slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt3: mod/noi/dif/loss/nce/logp -196.43/-13.73 /-182.70/ /-30.78 -7.02 /-0.49 29 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford [eos] tgt4: mod/noi/dif/loss/nce/logp -181.99/-13.77 /-168.23/ /-16.31 -6.28 /-0.47 30 [bos] mr. partlow could still feel the cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt5: mod/noi/dif/loss/nce/logp -174.07/-13.65 /-160.42/ /-8.50 -6.00 /-0.47 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been , him at hanford . [eos] cls0 - sp0 : -64.68 -2.23 30 0.07 [bos] this streets more made and a streets later on his cleaning there streets as he cleaning there a streets . is had been for an at . is [eos] cls0 - sp1 : -64.70 -2.23 30 0.07 [bos] i streets more made and a streets later on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls0 - sp2 : -64.71 -2.23 30 0.07 [bos] this streets more made and a streets later on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls0 - sp3 : -64.76 -2.23 30 0.07 [bos] this streets more made and a streets joined on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls0 - sp4 : -64.78 -2.23 30 0.07 [bos] i streets more made and a streets joined on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls1 - sp0 : -75.79 -2.61 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for an at . is [eos] cls1 - sp1 : -75.81 -2.61 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for ? at . is [eos] cls1 - sp2 : -75.83 -2.61 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for but at . is [eos] cls1 - sp3 : -75.98 -2.62 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for when at . is [eos] cls1 - sp4 : -76.13 -2.63 30 0.28 [bos] she dr. have made and a streets later on his cleaning there telephone as he cleaning space a streets . is had been for an at . is [eos] cls2 - sp0 : -87.49 -3.02 30 0.72 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had been for but at . is [eos] cls2 - sp1 : -87.57 -3.02 30 0.62 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had its for an at . is [eos] cls2 - sp2 : -87.80 -3.03 30 0.72 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had its for but at . is [eos] cls2 - sp3 : -87.84 -3.03 30 0.72 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had been for an at . is [eos] cls2 - sp4 : -88.40 -3.05 30 0.59 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had its for an at . is [eos] cls3 - sp0 : -76.24 -2.63 30 1.00 [bos] we corner have made and a state personal on his reliable almost first as he telephone space a almost state streets had been for an at center . [eos] cls3 - sp1 : -76.29 -2.63 30 1.00 [bos] we corner have made and a state personal on his reliable almost first as he telephone space a almost state crime had been for an at center . [eos] cls3 - sp2 : -76.29 -2.63 30 1.00 [bos] we corner have about and a state personal on his reliable almost first as he telephone space a almost state streets had been for an at center . [eos] cls3 - sp3 : -76.30 -2.63 30 1.00 [bos] we corner have about and a state personal on his reliable almost first as he telephone space a almost state crime had been for an at center . [eos] cls3 - sp4 : -76.30 -2.63 30 1.00 [bos] we corner have made and a state personal on his reliable almost first as he telephone space a almost state sponsored had been for an at center . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-113 src: none none 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt0: mod/noi/dif/loss/nce/logp -154.48/-2.80 /-151.68/0.69/-0.69 -5.33 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt1: mod/noi/dif/loss/nce/logp -154.48/-2.80 /-151.68/ /-0.69 -5.33 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt2: mod/noi/dif/loss/nce/logp -180.85/-14.65 /-166.20/ /-15.21 -6.24 /-0.51 30 [bos] mr. partlow could still feel a cold sweat on fifty slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt3: mod/noi/dif/loss/nce/logp -200.73/-13.73 /-187.00/ /-36.01 -7.17 /-0.49 29 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford [eos] tgt4: mod/noi/dif/loss/nce/logp -179.91/-13.77 /-166.14/ /-15.15 -6.20 /-0.47 30 [bos] mr. partlow could still feel the cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt5: mod/noi/dif/loss/nce/logp -172.76/-13.65 /-159.11/ /-8.12 -5.96 /-0.47 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been , him at hanford . [eos] cls0 - sp0 : -64.68 -2.23 30 0.07 [bos] this streets more made and a streets later on his cleaning there streets as he cleaning there a streets . is had been for an at . is [eos] cls0 - sp1 : -64.70 -2.23 30 0.07 [bos] i streets more made and a streets later on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls0 - sp2 : -64.71 -2.23 30 0.07 [bos] this streets more made and a streets later on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls0 - sp3 : -64.76 -2.23 30 0.07 [bos] this streets more made and a streets joined on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls0 - sp4 : -64.78 -2.23 30 0.07 [bos] i streets more made and a streets joined on his cleaning there streets as he cleaning what a streets . is had been for an at . is [eos] cls1 - sp0 : -75.79 -2.61 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for an at . is [eos] cls1 - sp1 : -75.81 -2.61 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for ? at . is [eos] cls1 - sp2 : -75.83 -2.61 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for but at . is [eos] cls1 - sp3 : -75.98 -2.62 30 0.28 [bos] it streets more about and a special later on his cleaning there telephone as he cleaning space a streets . is had been for when at . is [eos] cls1 - sp4 : -76.13 -2.63 30 0.28 [bos] she dr. have made and a streets later on his cleaning there telephone as he cleaning space a streets . is had been for an at . is [eos] cls2 - sp0 : -87.49 -3.02 30 0.72 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had been for but at . is [eos] cls2 - sp1 : -87.57 -3.02 30 0.62 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had its for an at . is [eos] cls2 - sp2 : -87.80 -3.03 30 0.72 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had its for but at . is [eos] cls2 - sp3 : -87.84 -3.03 30 0.72 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had been for an at . is [eos] cls2 - sp4 : -88.40 -3.05 30 0.59 [bos] it streets have about and a state yes on his agree couldn't telephone as he telephone space a streets yes unison had its for an at . is [eos] cls3 - sp0 : -76.24 -2.63 30 1.00 [bos] we corner have made and a state personal on his reliable almost first as he telephone space a almost state streets had been for an at center . [eos] cls3 - sp1 : -76.29 -2.63 30 1.00 [bos] we corner have made and a state personal on his reliable almost first as he telephone space a almost state crime had been for an at center . [eos] cls3 - sp2 : -76.29 -2.63 30 1.00 [bos] we corner have about and a state personal on his reliable almost first as he telephone space a almost state streets had been for an at center . [eos] cls3 - sp3 : -76.30 -2.63 30 1.00 [bos] we corner have about and a state personal on his reliable almost first as he telephone space a almost state crime had been for an at center . [eos] cls3 - sp4 : -76.30 -2.63 30 1.00 [bos] we corner have made and a state personal on his reliable almost first as he telephone space a almost state sponsored had been for an at center . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-114 src: none none 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt0: mod/noi/dif/loss/nce/logp -157.47/-2.80 /-154.68/0.69/-0.69 -5.43 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt1: mod/noi/dif/loss/nce/logp -157.47/-2.80 /-154.68/ /-0.69 -5.43 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt2: mod/noi/dif/loss/nce/logp -183.21/-14.65 /-168.56/ /-14.58 -6.32 /-0.51 30 [bos] mr. partlow could still feel a cold sweat on fifty slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt3: mod/noi/dif/loss/nce/logp -196.31/-13.73 /-182.58/ /-28.60 -7.01 /-0.49 29 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford [eos] tgt4: mod/noi/dif/loss/nce/logp -184.31/-13.77 /-170.54/ /-16.56 -6.36 /-0.47 30 [bos] mr. partlow could still feel the cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt5: mod/noi/dif/loss/nce/logp -174.64/-13.65 /-160.99/ /-7.01 -6.02 /-0.47 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been , him at hanford . [eos] cls0 - sp0 : -71.69 -2.47 30 0.03 [bos] : streets were about cleaning a first cleaning on his later there cleaning as he ( out a much society cleaning had its for but at . is [eos] cls0 - sp1 : -71.85 -2.48 30 0.03 [bos] : streets more about cleaning a first cleaning on his couldn't there cleaning as he ( out a much society cleaning had its for but at . is [eos] cls0 - sp2 : -71.91 -2.48 30 0.03 [bos] : streets were about cleaning a first cleaning on his couldn't there cleaning as he ( out a much society cleaning had its for but at . is [eos] cls0 - sp3 : -72.05 -2.48 30 0.03 [bos] : streets were about cleaning a first cleaning on his couldn't there cleaning as he rome out a much society cleaning had its for but at . is [eos] cls0 - sp4 : -72.30 -2.49 30 0.03 [bos] : streets were about cleaning a first cleaning on his later there cleaning as he ( out a property rome cleaning had its for but at . is [eos] cls1 - sp0 : -73.06 -2.52 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as he ( out a -- cleaning cleaning had its for but at . is [eos] cls1 - sp1 : -73.45 -2.53 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as he ( out a but cleaning cleaning had its for but at . is [eos] cls1 - sp2 : -73.60 -2.54 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as when ( out a -- cleaning cleaning had its for but at . is [eos] cls1 - sp3 : -73.62 -2.54 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as he ( out a when cleaning cleaning had its for but at . is [eos] cls1 - sp4 : -73.65 -2.54 30 0.31 [bos] : streets were about telephone a couldn't preceding on his property there telephone as he ( out a -- cleaning cleaning had its for but at . is [eos] cls2 - sp0 : -79.17 -2.73 30 0.59 [bos] : streets were about telephone a first 7 on his 2 there agree as he ( space a -- telephone telephone had its for but at . is [eos] cls2 - sp1 : -79.31 -2.73 30 0.69 [bos] : streets were about telephone a first flung on his 2 there telephone as he ( space a -- telephone telephone had its for but at center . [eos] cls2 - sp2 : -79.37 -2.74 30 0.69 [bos] : streets were about telephone a first flung on his 2 there agree as he ( space a -- telephone telephone had its for but at center . [eos] cls2 - sp3 : -79.40 -2.74 30 0.69 [bos] : streets were about telephone a first 7 on his 2 there telephone as he ( space a -- telephone telephone had its for but at center . [eos] cls2 - sp4 : -79.44 -2.74 30 0.69 [bos] : streets were about telephone a first 7 on his 2 there agree as he ( space a -- telephone telephone had its for but at center . [eos] cls3 - sp0 : -74.42 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there agree as he personal what a much example telephone had been for but at state . [eos] cls3 - sp1 : -74.44 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there telephone as he personal what a much example telephone had been for but at state . [eos] cls3 - sp2 : -74.45 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there agree as he personal what a much example telephone had been for but at center . [eos] cls3 - sp3 : -74.45 -2.57 30 1.00 [bos] she almost only about crime a almost personal on his 2 there telephone as he personal what a much example telephone had been for but at state . [eos] cls3 - sp4 : -74.45 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there telephone as he personal what a much example telephone had been for but at center . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-115 src: none none 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt0: mod/noi/dif/loss/nce/logp -156.44/-2.80 /-153.65/0.69/-0.69 -5.39 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt1: mod/noi/dif/loss/nce/logp -156.44/-2.80 /-153.65/ /-0.69 -5.39 /-0.10 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt2: mod/noi/dif/loss/nce/logp -181.94/-14.65 /-167.29/ /-14.34 -6.27 /-0.51 30 [bos] mr. partlow could still feel a cold sweat on fifty slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt3: mod/noi/dif/loss/nce/logp -200.16/-13.73 /-186.43/ /-33.48 -7.15 /-0.49 29 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford [eos] tgt4: mod/noi/dif/loss/nce/logp -181.89/-13.77 /-168.12/ /-15.17 -6.27 /-0.47 30 [bos] mr. partlow could still feel the cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been for him at hanford . [eos] tgt5: mod/noi/dif/loss/nce/logp -173.26/-13.65 /-159.62/ /-6.66 -5.97 /-0.47 30 [bos] mr. partlow could still feel a cold sweat on his slightly gray temples as he remembered what a near thing chemistry had been , him at hanford . [eos] cls0 - sp0 : -71.69 -2.47 30 0.03 [bos] : streets were about cleaning a first cleaning on his later there cleaning as he ( out a much society cleaning had its for but at . is [eos] cls0 - sp1 : -71.85 -2.48 30 0.03 [bos] : streets more about cleaning a first cleaning on his couldn't there cleaning as he ( out a much society cleaning had its for but at . is [eos] cls0 - sp2 : -71.91 -2.48 30 0.03 [bos] : streets were about cleaning a first cleaning on his couldn't there cleaning as he ( out a much society cleaning had its for but at . is [eos] cls0 - sp3 : -72.05 -2.48 30 0.03 [bos] : streets were about cleaning a first cleaning on his couldn't there cleaning as he rome out a much society cleaning had its for but at . is [eos] cls0 - sp4 : -72.30 -2.49 30 0.03 [bos] : streets were about cleaning a first cleaning on his later there cleaning as he ( out a property rome cleaning had its for but at . is [eos] cls1 - sp0 : -73.06 -2.52 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as he ( out a -- cleaning cleaning had its for but at . is [eos] cls1 - sp1 : -73.45 -2.53 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as he ( out a but cleaning cleaning had its for but at . is [eos] cls1 - sp2 : -73.60 -2.54 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as when ( out a -- cleaning cleaning had its for but at . is [eos] cls1 - sp3 : -73.62 -2.54 30 0.31 [bos] : streets were about telephone a couldn't preceding on his ! there telephone as he ( out a when cleaning cleaning had its for but at . is [eos] cls1 - sp4 : -73.65 -2.54 30 0.31 [bos] : streets were about telephone a couldn't preceding on his property there telephone as he ( out a -- cleaning cleaning had its for but at . is [eos] cls2 - sp0 : -79.17 -2.73 30 0.59 [bos] : streets were about telephone a first 7 on his 2 there agree as he ( space a -- telephone telephone had its for but at . is [eos] cls2 - sp1 : -79.31 -2.73 30 0.69 [bos] : streets were about telephone a first flung on his 2 there telephone as he ( space a -- telephone telephone had its for but at center . [eos] cls2 - sp2 : -79.37 -2.74 30 0.69 [bos] : streets were about telephone a first flung on his 2 there agree as he ( space a -- telephone telephone had its for but at center . [eos] cls2 - sp3 : -79.40 -2.74 30 0.69 [bos] : streets were about telephone a first 7 on his 2 there telephone as he ( space a -- telephone telephone had its for but at center . [eos] cls2 - sp4 : -79.44 -2.74 30 0.69 [bos] : streets were about telephone a first 7 on his 2 there agree as he ( space a -- telephone telephone had its for but at center . [eos] cls3 - sp0 : -74.42 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there agree as he personal what a much example telephone had been for but at state . [eos] cls3 - sp1 : -74.44 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there telephone as he personal what a much example telephone had been for but at state . [eos] cls3 - sp2 : -74.45 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there agree as he personal what a much example telephone had been for but at center . [eos] cls3 - sp3 : -74.45 -2.57 30 1.00 [bos] she almost only about crime a almost personal on his 2 there telephone as he personal what a much example telephone had been for but at state . [eos] cls3 - sp4 : -74.45 -2.57 30 1.00 [bos] she almost only about streets a almost personal on his 2 there telephone as he personal what a much example telephone had been for but at center . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-116 src: none none 6 [bos] weight , 160 . [eos] tgt0: mod/noi/dif/loss/nce/logp -24.01 /-0.50 /-23.51 /11.14/-11.14 -4.80 /-0.10 6 [bos] weight , 160 . [eos] tgt1: mod/noi/dif/loss/nce/logp -24.01 /-0.50 /-23.51 / /-11.14 -4.80 /-0.10 6 [bos] weight , 160 . [eos] tgt2: mod/noi/dif/loss/nce/logp -48.12 /-11.48 /-36.64 / /-24.26 -12.03/-2.87 5 [bos] weight , 160 [eos] tgt3: mod/noi/dif/loss/nce/logp -61.68 /-11.62 /-50.07 / /-37.69 -10.28/-1.94 7 [bos] weight , 160 . . [eos] tgt4: mod/noi/dif/loss/nce/logp -47.51 /-11.97 /-35.53 / /-23.16 -9.50 /-2.39 6 [bos] weight , 160 , [eos] tgt5: mod/noi/dif/loss/nce/logp -23.96 /-11.59 /-12.38 / /-0.00 -4.79 /-2.32 6 [bos] weight , exceeding . [eos] cls0 - sp0 : -7.60 -1.52 6 0.00 [bos] ( , no . [eos] cls0 - sp1 : -7.64 -1.53 6 0.00 [bos] ! , i . [eos] cls0 - sp2 : -7.71 -1.54 6 0.00 [bos] ( , joined . [eos] cls0 - sp3 : -7.78 -1.56 6 0.00 [bos] ! , joined . [eos] cls0 - sp4 : -7.81 -1.56 6 0.00 [bos] ! , no . [eos] cls1 - sp0 : -8.69 -1.74 6 0.40 [bos] ! , corner . [eos] cls1 - sp1 : -8.91 -1.78 6 0.40 [bos] ! , she . [eos] cls1 - sp2 : -9.36 -1.87 6 0.40 [bos] ! , don't . [eos] cls1 - sp3 : -9.96 -1.99 6 0.40 [bos] ! , telephone . [eos] cls1 - sp4 : -9.99 -2.00 6 0.40 [bos] ! , 7 . [eos] cls2 - sp0 : -7.74 -1.55 6 0.60 [bos] ! , corner . [eos] cls2 - sp1 : -8.21 -1.64 6 0.60 [bos] ! , don't . [eos] cls2 - sp2 : -12.98 -2.60 6 0.60 [bos] ! , 7 . [eos] cls2 - sp3 : -13.35 -2.67 6 0.60 [bos] ! , don't . [eos] cls2 - sp4 : -13.84 -2.77 6 0.60 [bos] ! , corner . [eos] cls3 - sp0 : -7.22 -1.44 6 0.80 [bos] ! , don't . [eos] cls3 - sp1 : -7.61 -1.52 6 0.80 [bos] ! , we . [eos] cls3 - sp2 : -7.93 -1.59 6 0.80 [bos] ! , no . [eos] cls3 - sp3 : -7.94 -1.59 6 0.80 [bos] ! , telephone . [eos] cls3 - sp4 : -8.07 -1.61 6 0.80 [bos] ! , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-117 src: none none 6 [bos] weight , 160 . [eos] tgt0: mod/noi/dif/loss/nce/logp -27.49 /-0.50 /-26.99 /6.31/-6.31 -5.50 /-0.10 6 [bos] weight , 160 . [eos] tgt1: mod/noi/dif/loss/nce/logp -27.49 /-0.50 /-26.99 / /-6.31 -5.50 /-0.10 6 [bos] weight , 160 . [eos] tgt2: mod/noi/dif/loss/nce/logp -58.45 /-11.48 /-46.97 / /-26.29 -14.61/-2.87 5 [bos] weight , 160 [eos] tgt3: mod/noi/dif/loss/nce/logp -66.60 /-11.62 /-54.98 / /-34.30 -11.10/-1.94 7 [bos] weight , 160 . . [eos] tgt4: mod/noi/dif/loss/nce/logp -48.00 /-11.97 /-36.03 / /-15.35 -9.60 /-2.39 6 [bos] weight , 160 , [eos] tgt5: mod/noi/dif/loss/nce/logp -32.27 /-11.59 /-20.68 / /-0.00 -6.45 /-2.32 6 [bos] weight , exceeding . [eos] cls0 - sp0 : -7.60 -1.52 6 0.00 [bos] ( , no . [eos] cls0 - sp1 : -7.64 -1.53 6 0.00 [bos] ! , i . [eos] cls0 - sp2 : -7.71 -1.54 6 0.00 [bos] ( , joined . [eos] cls0 - sp3 : -7.78 -1.56 6 0.00 [bos] ! , joined . [eos] cls0 - sp4 : -7.81 -1.56 6 0.00 [bos] ! , no . [eos] cls1 - sp0 : -8.69 -1.74 6 0.40 [bos] ! , corner . [eos] cls1 - sp1 : -8.91 -1.78 6 0.40 [bos] ! , she . [eos] cls1 - sp2 : -9.36 -1.87 6 0.40 [bos] ! , don't . [eos] cls1 - sp3 : -9.96 -1.99 6 0.40 [bos] ! , telephone . [eos] cls1 - sp4 : -9.99 -2.00 6 0.40 [bos] ! , 7 . [eos] cls2 - sp0 : -7.74 -1.55 6 0.60 [bos] ! , corner . [eos] cls2 - sp1 : -8.21 -1.64 6 0.60 [bos] ! , don't . [eos] cls2 - sp2 : -12.98 -2.60 6 0.60 [bos] ! , 7 . [eos] cls2 - sp3 : -13.35 -2.67 6 0.60 [bos] ! , don't . [eos] cls2 - sp4 : -13.84 -2.77 6 0.60 [bos] ! , corner . [eos] cls3 - sp0 : -7.22 -1.44 6 0.80 [bos] ! , don't . [eos] cls3 - sp1 : -7.61 -1.52 6 0.80 [bos] ! , we . [eos] cls3 - sp2 : -7.93 -1.59 6 0.80 [bos] ! , no . [eos] cls3 - sp3 : -7.94 -1.59 6 0.80 [bos] ! , telephone . [eos] cls3 - sp4 : -8.07 -1.61 6 0.80 [bos] ! , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-118 src: none none 6 [bos] weight , 160 . [eos] tgt0: mod/noi/dif/loss/nce/logp -25.85 /-0.50 /-25.35 /11.14/-11.14 -5.17 /-0.10 6 [bos] weight , 160 . [eos] tgt1: mod/noi/dif/loss/nce/logp -25.85 /-0.50 /-25.35 / /-11.14 -5.17 /-0.10 6 [bos] weight , 160 . [eos] tgt2: mod/noi/dif/loss/nce/logp -51.28 /-11.48 /-39.80 / /-25.59 -12.82/-2.87 5 [bos] weight , 160 [eos] tgt3: mod/noi/dif/loss/nce/logp -62.39 /-11.62 /-50.78 / /-36.57 -10.40/-1.94 7 [bos] weight , 160 . . [eos] tgt4: mod/noi/dif/loss/nce/logp -50.04 /-11.97 /-38.07 / /-23.86 -10.01/-2.39 6 [bos] weight , 160 , [eos] tgt5: mod/noi/dif/loss/nce/logp -25.80 /-11.59 /-14.21 / /-0.00 -5.16 /-2.32 6 [bos] weight , exceeding . [eos] cls0 - sp0 : -6.47 -1.29 6 0.00 [bos] she , no . [eos] cls0 - sp1 : -6.89 -1.38 6 0.00 [bos] i , no . [eos] cls0 - sp2 : -6.91 -1.38 6 0.00 [bos] couldn't , no . [eos] cls0 - sp3 : -7.39 -1.48 6 0.00 [bos] she , she . [eos] cls0 - sp4 : -7.47 -1.49 6 0.00 [bos] she , couldn't . [eos] cls1 - sp0 : -8.06 -1.61 6 0.40 [bos] ! , she . [eos] cls1 - sp1 : -8.15 -1.63 6 0.40 [bos] ! , couldn't . [eos] cls1 - sp2 : -8.37 -1.67 6 0.40 [bos] ! , no . [eos] cls1 - sp3 : -8.58 -1.72 6 0.40 [bos] ! , ! . [eos] cls1 - sp4 : -8.68 -1.74 6 0.40 [bos] ! , no . [eos] cls2 - sp0 : -8.00 -1.60 6 0.60 [bos] ! , don't . [eos] cls2 - sp1 : -12.61 -2.52 6 0.60 [bos] ! , ! . [eos] cls2 - sp2 : -12.89 -2.58 6 0.60 [bos] ! , ! . [eos] cls2 - sp3 : -12.89 -2.58 6 0.60 [bos] ! , no . [eos] cls2 - sp4 : -13.11 -2.62 6 0.60 [bos] she , we . [eos] cls3 - sp0 : -6.75 -1.35 6 0.80 [bos] ! , no . [eos] cls3 - sp1 : -6.87 -1.37 6 0.80 [bos] ! , don't . [eos] cls3 - sp2 : -7.20 -1.44 6 0.80 [bos] we , no . [eos] cls3 - sp3 : -7.23 -1.45 6 0.80 [bos] ! , we . [eos] cls3 - sp4 : -7.34 -1.47 6 0.80 [bos] 7 , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-119 src: none none 6 [bos] weight , 160 . [eos] tgt0: mod/noi/dif/loss/nce/logp -30.27 /-0.50 /-29.77 /6.08/-6.08 -6.05 /-0.10 6 [bos] weight , 160 . [eos] tgt1: mod/noi/dif/loss/nce/logp -30.27 /-0.50 /-29.77 / /-6.08 -6.05 /-0.10 6 [bos] weight , 160 . [eos] tgt2: mod/noi/dif/loss/nce/logp -59.90 /-11.48 /-48.42 / /-24.73 -14.97/-2.87 5 [bos] weight , 160 [eos] tgt3: mod/noi/dif/loss/nce/logp -68.66 /-11.62 /-57.04 / /-33.35 -11.44/-1.94 7 [bos] weight , 160 . . [eos] tgt4: mod/noi/dif/loss/nce/logp -51.10 /-11.97 /-39.13 / /-15.44 -10.22/-2.39 6 [bos] weight , 160 , [eos] tgt5: mod/noi/dif/loss/nce/logp -35.28 /-11.59 /-23.70 / /-0.00 -7.06 /-2.32 6 [bos] weight , exceeding . [eos] cls0 - sp0 : -6.47 -1.29 6 0.00 [bos] she , no . [eos] cls0 - sp1 : -6.89 -1.38 6 0.00 [bos] i , no . [eos] cls0 - sp2 : -6.91 -1.38 6 0.00 [bos] couldn't , no . [eos] cls0 - sp3 : -7.39 -1.48 6 0.00 [bos] she , she . [eos] cls0 - sp4 : -7.47 -1.49 6 0.00 [bos] she , couldn't . [eos] cls1 - sp0 : -8.06 -1.61 6 0.40 [bos] ! , she . [eos] cls1 - sp1 : -8.15 -1.63 6 0.40 [bos] ! , couldn't . [eos] cls1 - sp2 : -8.37 -1.67 6 0.40 [bos] ! , no . [eos] cls1 - sp3 : -8.58 -1.72 6 0.40 [bos] ! , ! . [eos] cls1 - sp4 : -8.68 -1.74 6 0.40 [bos] ! , no . [eos] cls2 - sp0 : -8.00 -1.60 6 0.60 [bos] ! , don't . [eos] cls2 - sp1 : -12.61 -2.52 6 0.60 [bos] ! , ! . [eos] cls2 - sp2 : -12.89 -2.58 6 0.60 [bos] ! , ! . [eos] cls2 - sp3 : -12.89 -2.58 6 0.60 [bos] ! , no . [eos] cls2 - sp4 : -13.11 -2.62 6 0.60 [bos] she , we . [eos] cls3 - sp0 : -6.75 -1.35 6 0.80 [bos] ! , no . [eos] cls3 - sp1 : -6.87 -1.37 6 0.80 [bos] ! , don't . [eos] cls3 - sp2 : -7.20 -1.44 6 0.80 [bos] we , no . [eos] cls3 - sp3 : -7.23 -1.45 6 0.80 [bos] ! , we . [eos] cls3 - sp4 : -7.34 -1.47 6 0.80 [bos] 7 , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-120 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -49.67 /-1.26 /-48.41 /0.69/-0.69 -4.52 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -49.67 /-1.26 /-48.41 / /-0.69 -4.52 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -84.23 /-12.23 /-72.00 / /-24.29 -8.42 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -173.37/-12.13 /-161.24/ /-113.53 -28.90/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.00 /-12.38 /-60.62 / /-12.91 -6.64 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -86.30 /-12.43 /-73.87 / /-26.16 -7.19 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -15.94 -1.45 12 0.00 [bos] she any but any , any but a ! . [eos] cls0 - sp1 : -16.14 -1.47 12 0.18 [bos] ! ! ! ? , later but a ! . [eos] cls0 - sp2 : -16.15 -1.47 12 0.18 [bos] ! ! ! ? , any but a ! . [eos] cls0 - sp3 : -16.27 -1.48 12 0.00 [bos] she any but any , no but a ! . [eos] cls0 - sp4 : -16.35 -1.49 12 0.00 [bos] she any him any , any but a ! . [eos] cls1 - sp0 : -15.39 -1.40 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp1 : -15.40 -1.40 12 0.36 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -15.60 -1.42 12 0.45 [bos] ! ! ! ! , later but a ! . [eos] cls1 - sp3 : -15.66 -1.42 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp4 : -15.73 -1.43 12 0.45 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp0 : -15.54 -1.41 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp1 : -15.67 -1.42 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp2 : -15.91 -1.45 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp3 : -15.96 -1.45 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -15.99 -1.45 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -14.79 -1.34 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -14.97 -1.36 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp2 : -15.02 -1.37 12 0.91 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp3 : -15.19 -1.38 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp4 : -15.30 -1.39 12 0.82 [bos] ! ! ! ! , ! ! a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-121 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -52.97 /-1.26 /-51.70 /0.69/-0.69 -4.82 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -52.97 /-1.26 /-51.70 / /-0.69 -4.82 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.70 /-12.23 /-73.47 / /-22.47 -8.57 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -161.73/-12.13 /-149.60/ /-98.59 -26.96/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -75.79 /-12.38 /-63.41 / /-12.40 -6.89 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -92.49 /-12.43 /-80.06 / /-29.05 -7.71 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -15.94 -1.45 12 0.00 [bos] she any but any , any but a ! . [eos] cls0 - sp1 : -16.14 -1.47 12 0.18 [bos] ! ! ! ? , later but a ! . [eos] cls0 - sp2 : -16.15 -1.47 12 0.18 [bos] ! ! ! ? , any but a ! . [eos] cls0 - sp3 : -16.27 -1.48 12 0.00 [bos] she any but any , no but a ! . [eos] cls0 - sp4 : -16.35 -1.49 12 0.00 [bos] she any him any , any but a ! . [eos] cls1 - sp0 : -15.39 -1.40 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp1 : -15.40 -1.40 12 0.36 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -15.60 -1.42 12 0.45 [bos] ! ! ! ! , later but a ! . [eos] cls1 - sp3 : -15.66 -1.42 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp4 : -15.73 -1.43 12 0.45 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp0 : -15.54 -1.41 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp1 : -15.67 -1.42 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp2 : -15.91 -1.45 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp3 : -15.96 -1.45 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -15.99 -1.45 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -14.79 -1.34 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -14.97 -1.36 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp2 : -15.02 -1.37 12 0.91 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp3 : -15.19 -1.38 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp4 : -15.30 -1.39 12 0.82 [bos] ! ! ! ! , ! ! a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-122 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -50.37 /-1.26 /-49.10 /0.69/-0.69 -4.58 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -50.37 /-1.26 /-49.10 / /-0.69 -4.58 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.01 /-12.23 /-73.78 / /-25.37 -8.60 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -193.53/-12.13 /-181.39/ /-132.98 -32.25/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.90 /-12.38 /-61.52 / /-13.11 -6.72 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -85.56 /-12.43 /-73.13 / /-24.72 -7.13 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -16.09 -1.46 12 0.00 [bos] i no but any , no but a ! . [eos] cls0 - sp1 : -16.35 -1.49 12 0.00 [bos] i no but any , joined but a ! . [eos] cls0 - sp2 : -16.37 -1.49 12 0.09 [bos] i no but any , no but a ! . [eos] cls0 - sp3 : -16.43 -1.49 12 0.00 [bos] she later but any , no but a ! . [eos] cls0 - sp4 : -16.46 -1.50 12 0.00 [bos] she later but any , joined but a ! . [eos] cls1 - sp0 : -16.54 -1.50 12 0.27 [bos] ! ! ! ? , later but a ! . [eos] cls1 - sp1 : -16.74 -1.52 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -16.77 -1.52 12 0.27 [bos] ! ! but any , no but a ! . [eos] cls1 - sp3 : -16.77 -1.52 12 0.36 [bos] ! ! ! ? , ! but a ! . [eos] cls1 - sp4 : -16.83 -1.53 12 0.27 [bos] ! ! but any , later but a ! . [eos] cls2 - sp0 : -16.82 -1.53 12 0.73 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp1 : -17.50 -1.59 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp2 : -17.71 -1.61 12 0.64 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp3 : -17.74 -1.61 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -17.87 -1.62 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -15.87 -1.44 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -16.27 -1.48 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp2 : -16.30 -1.48 12 0.82 [bos] ! ! ! ? , no but a ! . [eos] cls3 - sp3 : -16.31 -1.48 12 0.91 [bos] ! ! but any , later but a ! . [eos] cls3 - sp4 : -16.31 -1.48 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-123 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -53.18 /-1.26 /-51.91 /0.69/-0.69 -4.83 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -53.18 /-1.26 /-51.91 / /-0.69 -4.83 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -87.05 /-12.23 /-74.82 / /-23.60 -8.71 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -190.80/-12.13 /-178.67/ /-127.45 -31.80/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -76.44 /-12.38 /-64.06 / /-12.84 -6.95 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.17 /-12.43 /-78.74 / /-27.52 -7.60 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -16.09 -1.46 12 0.00 [bos] i no but any , no but a ! . [eos] cls0 - sp1 : -16.35 -1.49 12 0.00 [bos] i no but any , joined but a ! . [eos] cls0 - sp2 : -16.37 -1.49 12 0.09 [bos] i no but any , no but a ! . [eos] cls0 - sp3 : -16.43 -1.49 12 0.00 [bos] she later but any , no but a ! . [eos] cls0 - sp4 : -16.46 -1.50 12 0.00 [bos] she later but any , joined but a ! . [eos] cls1 - sp0 : -16.54 -1.50 12 0.27 [bos] ! ! ! ? , later but a ! . [eos] cls1 - sp1 : -16.74 -1.52 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -16.77 -1.52 12 0.27 [bos] ! ! but any , no but a ! . [eos] cls1 - sp3 : -16.77 -1.52 12 0.36 [bos] ! ! ! ? , ! but a ! . [eos] cls1 - sp4 : -16.83 -1.53 12 0.27 [bos] ! ! but any , later but a ! . [eos] cls2 - sp0 : -16.82 -1.53 12 0.73 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp1 : -17.50 -1.59 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp2 : -17.71 -1.61 12 0.64 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp3 : -17.74 -1.61 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -17.87 -1.62 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -15.87 -1.44 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -16.27 -1.48 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp2 : -16.30 -1.48 12 0.82 [bos] ! ! ! ? , no but a ! . [eos] cls3 - sp3 : -16.31 -1.48 12 0.91 [bos] ! ! but any , later but a ! . [eos] cls3 - sp4 : -16.31 -1.48 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-124 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -49.67 /-1.26 /-48.41 /0.69/-0.69 -4.52 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -49.67 /-1.26 /-48.41 / /-0.69 -4.52 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -84.23 /-12.23 /-72.00 / /-24.29 -8.42 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -173.37/-12.13 /-161.24/ /-113.53 -28.90/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.00 /-12.38 /-60.62 / /-12.91 -6.64 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -86.30 /-12.43 /-73.87 / /-26.16 -7.19 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -15.94 -1.45 12 0.00 [bos] she any but any , any but a ! . [eos] cls0 - sp1 : -16.14 -1.47 12 0.18 [bos] ! ! ! ? , later but a ! . [eos] cls0 - sp2 : -16.15 -1.47 12 0.18 [bos] ! ! ! ? , any but a ! . [eos] cls0 - sp3 : -16.27 -1.48 12 0.00 [bos] she any but any , no but a ! . [eos] cls0 - sp4 : -16.35 -1.49 12 0.00 [bos] she any him any , any but a ! . [eos] cls1 - sp0 : -15.39 -1.40 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp1 : -15.40 -1.40 12 0.36 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -15.60 -1.42 12 0.45 [bos] ! ! ! ! , later but a ! . [eos] cls1 - sp3 : -15.66 -1.42 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp4 : -15.73 -1.43 12 0.45 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp0 : -15.54 -1.41 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp1 : -15.67 -1.42 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp2 : -15.91 -1.45 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp3 : -15.96 -1.45 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -15.99 -1.45 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -14.79 -1.34 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -14.97 -1.36 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp2 : -15.02 -1.37 12 0.91 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp3 : -15.19 -1.38 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp4 : -15.30 -1.39 12 0.82 [bos] ! ! ! ! , ! ! a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-125 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -52.97 /-1.26 /-51.70 /0.69/-0.69 -4.82 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -52.97 /-1.26 /-51.70 / /-0.69 -4.82 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.70 /-12.23 /-73.47 / /-22.47 -8.57 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -161.73/-12.13 /-149.60/ /-98.59 -26.96/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -75.79 /-12.38 /-63.41 / /-12.40 -6.89 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -92.49 /-12.43 /-80.06 / /-29.05 -7.71 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -15.94 -1.45 12 0.00 [bos] she any but any , any but a ! . [eos] cls0 - sp1 : -16.14 -1.47 12 0.18 [bos] ! ! ! ? , later but a ! . [eos] cls0 - sp2 : -16.15 -1.47 12 0.18 [bos] ! ! ! ? , any but a ! . [eos] cls0 - sp3 : -16.27 -1.48 12 0.00 [bos] she any but any , no but a ! . [eos] cls0 - sp4 : -16.35 -1.49 12 0.00 [bos] she any him any , any but a ! . [eos] cls1 - sp0 : -15.39 -1.40 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp1 : -15.40 -1.40 12 0.36 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -15.60 -1.42 12 0.45 [bos] ! ! ! ! , later but a ! . [eos] cls1 - sp3 : -15.66 -1.42 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp4 : -15.73 -1.43 12 0.45 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp0 : -15.54 -1.41 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp1 : -15.67 -1.42 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp2 : -15.91 -1.45 12 0.55 [bos] ! ! ! ! , ! ! a ! . [eos] cls2 - sp3 : -15.96 -1.45 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -15.99 -1.45 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -14.79 -1.34 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -14.97 -1.36 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp2 : -15.02 -1.37 12 0.91 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp3 : -15.19 -1.38 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp4 : -15.30 -1.39 12 0.82 [bos] ! ! ! ! , ! ! a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-126 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -50.37 /-1.26 /-49.10 /0.69/-0.69 -4.58 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -50.37 /-1.26 /-49.10 / /-0.69 -4.58 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.01 /-12.23 /-73.78 / /-25.37 -8.60 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -193.53/-12.13 /-181.39/ /-132.98 -32.25/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.90 /-12.38 /-61.52 / /-13.11 -6.72 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -85.56 /-12.43 /-73.13 / /-24.72 -7.13 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -16.09 -1.46 12 0.00 [bos] i no but any , no but a ! . [eos] cls0 - sp1 : -16.35 -1.49 12 0.00 [bos] i no but any , joined but a ! . [eos] cls0 - sp2 : -16.37 -1.49 12 0.09 [bos] i no but any , no but a ! . [eos] cls0 - sp3 : -16.43 -1.49 12 0.00 [bos] she later but any , no but a ! . [eos] cls0 - sp4 : -16.46 -1.50 12 0.00 [bos] she later but any , joined but a ! . [eos] cls1 - sp0 : -16.54 -1.50 12 0.27 [bos] ! ! ! ? , later but a ! . [eos] cls1 - sp1 : -16.74 -1.52 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -16.77 -1.52 12 0.27 [bos] ! ! but any , no but a ! . [eos] cls1 - sp3 : -16.77 -1.52 12 0.36 [bos] ! ! ! ? , ! but a ! . [eos] cls1 - sp4 : -16.83 -1.53 12 0.27 [bos] ! ! but any , later but a ! . [eos] cls2 - sp0 : -16.82 -1.53 12 0.73 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp1 : -17.50 -1.59 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp2 : -17.71 -1.61 12 0.64 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp3 : -17.74 -1.61 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -17.87 -1.62 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -15.87 -1.44 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -16.27 -1.48 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp2 : -16.30 -1.48 12 0.82 [bos] ! ! ! ? , no but a ! . [eos] cls3 - sp3 : -16.31 -1.48 12 0.91 [bos] ! ! but any , later but a ! . [eos] cls3 - sp4 : -16.31 -1.48 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-127 src: none none 12 [bos] just give him time , give him a chance . [eos] tgt0: mod/noi/dif/loss/nce/logp -53.18 /-1.26 /-51.91 /0.69/-0.69 -4.83 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt1: mod/noi/dif/loss/nce/logp -53.18 /-1.26 /-51.91 / /-0.69 -4.83 /-0.11 12 [bos] just give him time , give him a chance . [eos] tgt2: mod/noi/dif/loss/nce/logp -87.05 /-12.23 /-74.82 / /-23.60 -8.71 /-1.22 11 [bos] just give him time , give him a chance [eos] tgt3: mod/noi/dif/loss/nce/logp -190.80/-12.13 /-178.67/ /-127.45 -31.80/-2.02 7 [bos] just give him time . [eos] tgt4: mod/noi/dif/loss/nce/logp -76.44 /-12.38 /-64.06 / /-12.84 -6.95 /-1.13 12 [bos] just give him time , give him the chance . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.17 /-12.43 /-78.74 / /-27.52 -7.60 /-1.04 13 [bos] just give him time , give him a chance . . [eos] cls0 - sp0 : -16.09 -1.46 12 0.00 [bos] i no but any , no but a ! . [eos] cls0 - sp1 : -16.35 -1.49 12 0.00 [bos] i no but any , joined but a ! . [eos] cls0 - sp2 : -16.37 -1.49 12 0.09 [bos] i no but any , no but a ! . [eos] cls0 - sp3 : -16.43 -1.49 12 0.00 [bos] she later but any , no but a ! . [eos] cls0 - sp4 : -16.46 -1.50 12 0.00 [bos] she later but any , joined but a ! . [eos] cls1 - sp0 : -16.54 -1.50 12 0.27 [bos] ! ! ! ? , later but a ! . [eos] cls1 - sp1 : -16.74 -1.52 12 0.45 [bos] ! ! ! ! , ! but a ! . [eos] cls1 - sp2 : -16.77 -1.52 12 0.27 [bos] ! ! but any , no but a ! . [eos] cls1 - sp3 : -16.77 -1.52 12 0.36 [bos] ! ! ! ? , ! but a ! . [eos] cls1 - sp4 : -16.83 -1.53 12 0.27 [bos] ! ! but any , later but a ! . [eos] cls2 - sp0 : -16.82 -1.53 12 0.73 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp1 : -17.50 -1.59 12 0.55 [bos] ! ! ! ! , ! but a ! . [eos] cls2 - sp2 : -17.71 -1.61 12 0.64 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp3 : -17.74 -1.61 12 0.55 [bos] ! ! ! ? , later but a ! . [eos] cls2 - sp4 : -17.87 -1.62 12 0.55 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp0 : -15.87 -1.44 12 0.82 [bos] ! ! ! ? , later but a ! . [eos] cls3 - sp1 : -16.27 -1.48 12 0.82 [bos] ! ! ! ! , later but a ! . [eos] cls3 - sp2 : -16.30 -1.48 12 0.82 [bos] ! ! ! ? , no but a ! . [eos] cls3 - sp3 : -16.31 -1.48 12 0.91 [bos] ! ! but any , later but a ! . [eos] cls3 - sp4 : -16.31 -1.48 12 0.91 [bos] ! ! ! ? , later but a ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-128 src: none none 13 [bos] when i went to college they begged you to come . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.64 /-1.33 /-50.31 /0.7/-0.70 -4.30 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.64 /-1.33 /-50.31 / /-0.70 -4.30 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt2: mod/noi/dif/loss/nce/logp -87.89 /-12.45 /-75.45 / /-25.84 -6.76 /-0.96 14 [bos] when i went to college they begged you to come . . [eos] tgt3: mod/noi/dif/loss/nce/logp -81.97 /-12.22 /-69.75 / /-20.14 -7.45 /-1.11 12 [bos] when i went to college they begged you to come [eos] tgt4: mod/noi/dif/loss/nce/logp -68.38 /-12.44 /-55.94 / /-6.33 -5.70 /-1.04 13 [bos] the i went to college they begged you to come . [eos] tgt5: mod/noi/dif/loss/nce/logp -66.63 /-11.73 /-54.90 / /-5.29 -5.55 /-0.98 13 [bos] his i went to college they begged you to come . [eos] cls0 - sp0 : -18.39 -1.67 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp1 : -18.57 -1.69 12 0.18 [bos] ! ! couldn't to ! ! ! ! to ! [eos] cls0 - sp2 : -18.68 -1.70 12 0.18 [bos] ! ! all to ! ! ! ! to ! [eos] cls0 - sp3 : -20.01 -1.82 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp4 : -21.62 -1.80 13 0.08 [bos] ! i all to no they streets ! to ! . [eos] cls1 - sp0 : -18.34 -1.67 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp1 : -18.51 -1.68 12 0.27 [bos] ! ! couldn't to ! ! ! ! to ! [eos] cls1 - sp2 : -18.66 -1.70 12 0.36 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp3 : -18.73 -1.70 12 0.27 [bos] ! ! all to ! ! ! ! to ! [eos] cls1 - sp4 : -18.76 -1.71 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp0 : -16.58 -1.51 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls2 - sp1 : -17.18 -1.56 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls2 - sp2 : -17.29 -1.57 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls2 - sp3 : -17.38 -1.58 12 0.73 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp4 : -17.45 -1.59 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp0 : -14.64 -1.33 12 1.00 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp1 : -15.07 -1.37 12 1.00 [bos] ! ! she to ! ! ! ! to ! [eos] cls3 - sp2 : -15.23 -1.38 12 0.91 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp3 : -15.59 -1.42 12 0.91 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp4 : -15.59 -1.42 12 0.91 [bos] ! ! all to ! ! ! ! to ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-129 src: none none 13 [bos] when i went to college they begged you to come . [eos] tgt0: mod/noi/dif/loss/nce/logp -54.13 /-1.33 /-52.81 /0.72/-0.72 -4.51 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt1: mod/noi/dif/loss/nce/logp -54.13 /-1.33 /-52.81 / /-0.72 -4.51 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt2: mod/noi/dif/loss/nce/logp -91.81 /-12.45 /-79.37 / /-27.28 -7.06 /-0.96 14 [bos] when i went to college they begged you to come . . [eos] tgt3: mod/noi/dif/loss/nce/logp -89.66 /-12.22 /-77.44 / /-25.35 -8.15 /-1.11 12 [bos] when i went to college they begged you to come [eos] tgt4: mod/noi/dif/loss/nce/logp -71.67 /-12.44 /-59.23 / /-7.14 -5.97 /-1.04 13 [bos] the i went to college they begged you to come . [eos] tgt5: mod/noi/dif/loss/nce/logp -67.66 /-11.73 /-55.93 / /-3.84 -5.64 /-0.98 13 [bos] his i went to college they begged you to come . [eos] cls0 - sp0 : -18.39 -1.67 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp1 : -18.57 -1.69 12 0.18 [bos] ! ! couldn't to ! ! ! ! to ! [eos] cls0 - sp2 : -18.68 -1.70 12 0.18 [bos] ! ! all to ! ! ! ! to ! [eos] cls0 - sp3 : -20.01 -1.82 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp4 : -21.62 -1.80 13 0.08 [bos] ! i all to no they streets ! to ! . [eos] cls1 - sp0 : -18.34 -1.67 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp1 : -18.51 -1.68 12 0.27 [bos] ! ! couldn't to ! ! ! ! to ! [eos] cls1 - sp2 : -18.66 -1.70 12 0.36 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp3 : -18.73 -1.70 12 0.27 [bos] ! ! all to ! ! ! ! to ! [eos] cls1 - sp4 : -18.76 -1.71 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp0 : -16.58 -1.51 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls2 - sp1 : -17.18 -1.56 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls2 - sp2 : -17.29 -1.57 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls2 - sp3 : -17.38 -1.58 12 0.73 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp4 : -17.45 -1.59 12 0.73 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp0 : -14.64 -1.33 12 1.00 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp1 : -15.07 -1.37 12 1.00 [bos] ! ! she to ! ! ! ! to ! [eos] cls3 - sp2 : -15.23 -1.38 12 0.91 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp3 : -15.59 -1.42 12 0.91 [bos] ! ! all to ! ! ! ! to ! [eos] cls3 - sp4 : -15.59 -1.42 12 0.91 [bos] ! ! all to ! ! ! ! to ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-130 src: none none 13 [bos] when i went to college they begged you to come . [eos] tgt0: mod/noi/dif/loss/nce/logp -48.84 /-1.33 /-47.51 /0.7/-0.70 -4.07 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt1: mod/noi/dif/loss/nce/logp -48.84 /-1.33 /-47.51 / /-0.70 -4.07 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt2: mod/noi/dif/loss/nce/logp -84.55 /-12.45 /-72.11 / /-25.29 -6.50 /-0.96 14 [bos] when i went to college they begged you to come . . [eos] tgt3: mod/noi/dif/loss/nce/logp -80.28 /-12.22 /-68.06 / /-21.25 -7.30 /-1.11 12 [bos] when i went to college they begged you to come [eos] tgt4: mod/noi/dif/loss/nce/logp -65.62 /-12.44 /-53.18 / /-6.36 -5.47 /-1.04 13 [bos] the i went to college they begged you to come . [eos] tgt5: mod/noi/dif/loss/nce/logp -64.76 /-11.73 /-53.03 / /-6.21 -5.40 /-0.98 13 [bos] his i went to college they begged you to come . [eos] cls0 - sp0 : -16.94 -1.54 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp1 : -17.20 -1.56 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp2 : -17.42 -1.58 12 0.09 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp3 : -17.59 -1.60 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp4 : -17.76 -1.61 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp0 : -16.55 -1.50 12 0.36 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp1 : -16.61 -1.51 12 0.36 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp2 : -16.61 -1.51 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp3 : -17.05 -1.55 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp4 : -17.06 -1.55 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp0 : -15.96 -1.45 12 0.73 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp1 : -16.60 -1.51 12 0.73 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp2 : -16.71 -1.39 13 0.67 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls2 - sp3 : -17.78 -1.48 13 0.67 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls2 - sp4 : -17.87 -1.49 13 0.67 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls3 - sp0 : -14.09 -1.17 13 1.00 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls3 - sp1 : -14.41 -1.20 13 0.92 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls3 - sp2 : -14.72 -1.34 12 1.00 [bos] ! ! ! to ! ! ! ! to ! [eos] cls3 - sp3 : -14.91 -1.36 12 0.91 [bos] ! ! ! to ! ! ! ! to ! [eos] cls3 - sp4 : -15.13 -1.26 13 0.92 [bos] ! ! ! to ! ! ! ! to ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-131 src: none none 13 [bos] when i went to college they begged you to come . [eos] tgt0: mod/noi/dif/loss/nce/logp -52.57 /-1.33 /-51.25 /0.7/-0.70 -4.38 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt1: mod/noi/dif/loss/nce/logp -52.57 /-1.33 /-51.25 / /-0.70 -4.38 /-0.11 13 [bos] when i went to college they begged you to come . [eos] tgt2: mod/noi/dif/loss/nce/logp -90.00 /-12.45 /-77.56 / /-27.02 -6.92 /-0.96 14 [bos] when i went to college they begged you to come . . [eos] tgt3: mod/noi/dif/loss/nce/logp -88.88 /-12.22 /-76.66 / /-26.12 -8.08 /-1.11 12 [bos] when i went to college they begged you to come [eos] tgt4: mod/noi/dif/loss/nce/logp -70.00 /-12.44 /-57.56 / /-7.02 -5.83 /-1.04 13 [bos] the i went to college they begged you to come . [eos] tgt5: mod/noi/dif/loss/nce/logp -66.83 /-11.73 /-55.10 / /-4.56 -5.57 /-0.98 13 [bos] his i went to college they begged you to come . [eos] cls0 - sp0 : -16.94 -1.54 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp1 : -17.20 -1.56 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp2 : -17.42 -1.58 12 0.09 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp3 : -17.59 -1.60 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls0 - sp4 : -17.76 -1.61 12 0.18 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp0 : -16.55 -1.50 12 0.36 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp1 : -16.61 -1.51 12 0.36 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp2 : -16.61 -1.51 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp3 : -17.05 -1.55 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls1 - sp4 : -17.06 -1.55 12 0.27 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp0 : -15.96 -1.45 12 0.73 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp1 : -16.60 -1.51 12 0.73 [bos] ! ! ! to ! ! ! ! to ! [eos] cls2 - sp2 : -16.71 -1.39 13 0.67 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls2 - sp3 : -17.78 -1.48 13 0.67 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls2 - sp4 : -17.87 -1.49 13 0.67 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls3 - sp0 : -14.09 -1.17 13 1.00 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls3 - sp1 : -14.41 -1.20 13 0.92 [bos] ! ! ! to ! ! ! ! to ! . [eos] cls3 - sp2 : -14.72 -1.34 12 1.00 [bos] ! ! ! to ! ! ! ! to ! [eos] cls3 - sp3 : -14.91 -1.36 12 0.91 [bos] ! ! ! to ! ! ! ! to ! [eos] cls3 - sp4 : -15.13 -1.26 13 0.92 [bos] ! ! ! to ! ! ! ! to ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-132 src: none none 5 [bos] david grinned . [eos] tgt0: mod/noi/dif/loss/nce/logp -25.54 /-0.39 /-25.16 /5.46/-5.46 -6.39 /-0.10 5 [bos] david grinned . [eos] tgt1: mod/noi/dif/loss/nce/logp -25.54 /-0.39 /-25.16 / /-5.46 -6.39 /-0.10 5 [bos] david grinned . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.75 /-11.33 /-44.42 / /-24.72 -18.58/-3.78 4 [bos] david grinned [eos] tgt3: mod/noi/dif/loss/nce/logp -61.65 /-11.53 /-50.12 / /-30.42 -12.33/-2.31 6 [bos] david grinned . . [eos] tgt4: mod/noi/dif/loss/nce/logp -47.15 /-11.93 /-35.22 / /-15.52 -11.79/-2.98 5 [bos] david grinned , [eos] tgt5: mod/noi/dif/loss/nce/logp -31.91 /-12.20 /-19.71 / /-0.01 -7.98 /-3.05 5 [bos] david dupont . [eos] cls0 - sp0 : -7.27 -1.82 5 0.00 [bos] ! ! . [eos] cls0 - sp1 : -7.31 -1.83 5 0.00 [bos] she ) . [eos] cls0 - sp2 : -7.56 -1.89 5 0.00 [bos] ! ) . [eos] cls0 - sp3 : -7.68 -1.92 5 0.00 [bos] she no . [eos] cls0 - sp4 : -7.77 -1.94 5 0.00 [bos] 7 ) . [eos] cls1 - sp0 : -6.82 -1.71 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -7.24 -1.81 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -7.51 -1.88 5 0.25 [bos] ! ) . [eos] cls1 - sp3 : -8.42 -2.11 5 0.25 [bos] ! no . [eos] cls1 - sp4 : -8.64 -2.16 5 0.25 [bos] ! 7 . [eos] cls2 - sp0 : -6.27 -1.57 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -8.13 -2.03 5 0.50 [bos] ! ) . [eos] cls2 - sp2 : -8.42 -2.11 5 0.50 [bos] 7 ! . [eos] cls2 - sp3 : -8.62 -2.16 5 0.50 [bos] ! no . [eos] cls2 - sp4 : -9.01 -2.25 5 0.50 [bos] ! 7 . [eos] cls3 - sp0 : -7.34 -1.84 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -7.84 -1.96 5 0.75 [bos] 7 ) . [eos] cls3 - sp2 : -7.98 -2.00 5 0.75 [bos] 7 ! . [eos] cls3 - sp3 : -8.02 -2.00 5 0.75 [bos] ! 7 . [eos] cls3 - sp4 : -8.14 -2.03 5 0.75 [bos] 7 no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-133 src: none none 5 [bos] david grinned . [eos] tgt0: mod/noi/dif/loss/nce/logp -30.21 /-0.39 /-29.82 /4.13/-4.13 -7.55 /-0.10 5 [bos] david grinned . [eos] tgt1: mod/noi/dif/loss/nce/logp -30.21 /-0.39 /-29.82 / /-4.13 -7.55 /-0.10 5 [bos] david grinned . [eos] tgt2: mod/noi/dif/loss/nce/logp -60.85 /-11.33 /-49.52 / /-23.83 -20.28/-3.78 4 [bos] david grinned [eos] tgt3: mod/noi/dif/loss/nce/logp -67.72 /-11.53 /-56.19 / /-30.50 -13.54/-2.31 6 [bos] david grinned . . [eos] tgt4: mod/noi/dif/loss/nce/logp -53.17 /-11.93 /-41.23 / /-15.54 -13.29/-2.98 5 [bos] david grinned , [eos] tgt5: mod/noi/dif/loss/nce/logp -37.93 /-12.20 /-25.72 / /-0.03 -9.48 /-3.05 5 [bos] david dupont . [eos] cls0 - sp0 : -7.27 -1.82 5 0.00 [bos] ! ! . [eos] cls0 - sp1 : -7.31 -1.83 5 0.00 [bos] she ) . [eos] cls0 - sp2 : -7.56 -1.89 5 0.00 [bos] ! ) . [eos] cls0 - sp3 : -7.68 -1.92 5 0.00 [bos] she no . [eos] cls0 - sp4 : -7.77 -1.94 5 0.00 [bos] 7 ) . [eos] cls1 - sp0 : -6.82 -1.71 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -7.24 -1.81 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -7.51 -1.88 5 0.25 [bos] ! ) . [eos] cls1 - sp3 : -8.42 -2.11 5 0.25 [bos] ! no . [eos] cls1 - sp4 : -8.64 -2.16 5 0.25 [bos] ! 7 . [eos] cls2 - sp0 : -6.27 -1.57 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -8.13 -2.03 5 0.50 [bos] ! ) . [eos] cls2 - sp2 : -8.42 -2.11 5 0.50 [bos] 7 ! . [eos] cls2 - sp3 : -8.62 -2.16 5 0.50 [bos] ! no . [eos] cls2 - sp4 : -9.01 -2.25 5 0.50 [bos] ! 7 . [eos] cls3 - sp0 : -7.34 -1.84 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -7.84 -1.96 5 0.75 [bos] 7 ) . [eos] cls3 - sp2 : -7.98 -2.00 5 0.75 [bos] 7 ! . [eos] cls3 - sp3 : -8.02 -2.00 5 0.75 [bos] ! 7 . [eos] cls3 - sp4 : -8.14 -2.03 5 0.75 [bos] 7 no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-134 src: none none 5 [bos] david grinned . [eos] tgt0: mod/noi/dif/loss/nce/logp -25.55 /-0.39 /-25.17 /5.35/-5.35 -6.39 /-0.10 5 [bos] david grinned . [eos] tgt1: mod/noi/dif/loss/nce/logp -25.55 /-0.39 /-25.17 / /-5.35 -6.39 /-0.10 5 [bos] david grinned . [eos] tgt2: mod/noi/dif/loss/nce/logp -58.69 /-11.33 /-47.36 / /-27.54 -19.56/-3.78 4 [bos] david grinned [eos] tgt3: mod/noi/dif/loss/nce/logp -59.93 /-11.53 /-48.40 / /-28.57 -11.99/-2.31 6 [bos] david grinned . . [eos] tgt4: mod/noi/dif/loss/nce/logp -46.74 /-11.93 /-34.81 / /-14.99 -11.69/-2.98 5 [bos] david grinned , [eos] tgt5: mod/noi/dif/loss/nce/logp -32.04 /-12.20 /-19.83 / /-0.01 -8.01 /-3.05 5 [bos] david dupont . [eos] cls0 - sp0 : -6.21 -1.55 5 0.00 [bos] i no . [eos] cls0 - sp1 : -6.42 -1.60 5 0.00 [bos] she no . [eos] cls0 - sp2 : -6.78 -1.69 5 0.00 [bos] no no . [eos] cls0 - sp3 : -6.83 -1.71 5 0.00 [bos] we no . [eos] cls0 - sp4 : -7.25 -1.81 5 0.00 [bos] couldn't no . [eos] cls1 - sp0 : -6.51 -1.63 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -6.92 -1.73 5 0.25 [bos] ! no . [eos] cls1 - sp2 : -7.15 -1.79 5 0.25 [bos] ! ! . [eos] cls1 - sp3 : -7.20 -1.80 5 0.25 [bos] ! ) . [eos] cls1 - sp4 : -7.41 -1.85 5 0.25 [bos] no no . [eos] cls2 - sp0 : -5.82 -1.45 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -7.19 -1.80 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -7.76 -1.94 5 0.50 [bos] ! ) . [eos] cls2 - sp3 : -8.20 -2.05 5 0.50 [bos] no no . [eos] cls2 - sp4 : -8.40 -2.10 5 0.50 [bos] don't no . [eos] cls3 - sp0 : -6.70 -1.68 5 0.75 [bos] we no . [eos] cls3 - sp1 : -7.17 -1.79 5 0.75 [bos] she no . [eos] cls3 - sp2 : -7.23 -1.81 5 0.75 [bos] ! no . [eos] cls3 - sp3 : -7.38 -1.85 5 0.75 [bos] ! ! . [eos] cls3 - sp4 : -7.43 -1.86 5 0.75 [bos] don't no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-135 src: none none 5 [bos] david grinned . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.01 /-0.39 /-30.63 /4.34/-4.34 -7.75 /-0.10 5 [bos] david grinned . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.01 /-0.39 /-30.63 / /-4.34 -7.75 /-0.10 5 [bos] david grinned . [eos] tgt2: mod/noi/dif/loss/nce/logp -63.58 /-11.33 /-52.25 / /-25.96 -21.19/-3.78 4 [bos] david grinned [eos] tgt3: mod/noi/dif/loss/nce/logp -67.18 /-11.53 /-55.64 / /-29.35 -13.44/-2.31 6 [bos] david grinned . . [eos] tgt4: mod/noi/dif/loss/nce/logp -54.45 /-11.93 /-42.51 / /-16.22 -13.61/-2.98 5 [bos] david grinned , [eos] tgt5: mod/noi/dif/loss/nce/logp -38.52 /-12.20 /-26.32 / /-0.03 -9.63 /-3.05 5 [bos] david dupont . [eos] cls0 - sp0 : -6.21 -1.55 5 0.00 [bos] i no . [eos] cls0 - sp1 : -6.42 -1.60 5 0.00 [bos] she no . [eos] cls0 - sp2 : -6.78 -1.69 5 0.00 [bos] no no . [eos] cls0 - sp3 : -6.83 -1.71 5 0.00 [bos] we no . [eos] cls0 - sp4 : -7.25 -1.81 5 0.00 [bos] couldn't no . [eos] cls1 - sp0 : -6.51 -1.63 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -6.92 -1.73 5 0.25 [bos] ! no . [eos] cls1 - sp2 : -7.15 -1.79 5 0.25 [bos] ! ! . [eos] cls1 - sp3 : -7.20 -1.80 5 0.25 [bos] ! ) . [eos] cls1 - sp4 : -7.41 -1.85 5 0.25 [bos] no no . [eos] cls2 - sp0 : -5.82 -1.45 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -7.19 -1.80 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -7.76 -1.94 5 0.50 [bos] ! ) . [eos] cls2 - sp3 : -8.20 -2.05 5 0.50 [bos] no no . [eos] cls2 - sp4 : -8.40 -2.10 5 0.50 [bos] don't no . [eos] cls3 - sp0 : -6.70 -1.68 5 0.75 [bos] we no . [eos] cls3 - sp1 : -7.17 -1.79 5 0.75 [bos] she no . [eos] cls3 - sp2 : -7.23 -1.81 5 0.75 [bos] ! no . [eos] cls3 - sp3 : -7.38 -1.85 5 0.75 [bos] ! ! . [eos] cls3 - sp4 : -7.43 -1.86 5 0.75 [bos] don't no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-136 src: none none 9 [bos] you do seem somewhat tattered '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -43.02 /-0.79 /-42.22 /0.69/-0.69 -5.38 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -43.02 /-0.79 /-42.22 / /-0.69 -5.38 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -73.11 /-11.68 /-61.44 / /-19.91 -10.44/-1.67 8 [bos] you do seem somewhat tattered '' [eos] tgt3: mod/noi/dif/loss/nce/logp -138.85/-12.16 /-126.69/ /-85.17 -23.14/-2.03 7 [bos] you do seem somewhat tattered [eos] tgt4: mod/noi/dif/loss/nce/logp -84.98 /-11.49 /-73.49 / /-31.96 -12.14/-1.64 8 [bos] you do seem somewhat tattered . [eos] tgt5: mod/noi/dif/loss/nce/logp -79.21 /-11.97 /-67.24 / /-25.72 -8.80 /-1.33 10 [bos] you do seem somewhat tattered '' . . [eos] cls0 - sp0 : -5.76 -1.15 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -6.03 -1.21 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp2 : -6.16 -1.23 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -6.47 -1.29 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -6.79 -1.36 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -5.78 -1.16 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -6.03 -1.21 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -6.07 -1.21 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -6.42 -1.28 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -6.69 -1.34 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -5.76 -1.15 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -5.92 -1.18 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -5.99 -1.20 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -6.09 -1.22 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -6.29 -1.26 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -4.34 -0.87 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -5.18 -1.04 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -5.56 -1.11 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -5.57 -1.11 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -5.66 -1.13 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-137 src: none none 9 [bos] you do seem somewhat tattered '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -50.00 /-0.79 /-49.21 /0.69/-0.69 -6.25 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -50.00 /-0.79 /-49.21 / /-0.69 -6.25 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -79.90 /-11.68 /-68.23 / /-19.71 -11.41/-1.67 8 [bos] you do seem somewhat tattered '' [eos] tgt3: mod/noi/dif/loss/nce/logp -136.38/-12.16 /-124.22/ /-75.71 -22.73/-2.03 7 [bos] you do seem somewhat tattered [eos] tgt4: mod/noi/dif/loss/nce/logp -90.79 /-11.49 /-79.30 / /-30.79 -12.97/-1.64 8 [bos] you do seem somewhat tattered . [eos] tgt5: mod/noi/dif/loss/nce/logp -88.65 /-11.97 /-76.68 / /-28.16 -9.85 /-1.33 10 [bos] you do seem somewhat tattered '' . . [eos] cls0 - sp0 : -5.76 -1.15 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -6.03 -1.21 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp2 : -6.16 -1.23 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -6.47 -1.29 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -6.79 -1.36 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -5.78 -1.16 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -6.03 -1.21 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -6.07 -1.21 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -6.42 -1.28 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -6.69 -1.34 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -5.76 -1.15 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -5.92 -1.18 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -5.99 -1.20 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -6.09 -1.22 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -6.29 -1.26 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -4.34 -0.87 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -5.18 -1.04 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -5.56 -1.11 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -5.57 -1.11 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -5.66 -1.13 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-138 src: none none 9 [bos] you do seem somewhat tattered '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -44.43 /-0.79 /-43.63 /0.69/-0.69 -5.55 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -44.43 /-0.79 /-43.63 / /-0.69 -5.55 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -78.07 /-11.68 /-66.40 / /-23.46 -11.15/-1.67 8 [bos] you do seem somewhat tattered '' [eos] tgt3: mod/noi/dif/loss/nce/logp -138.54/-12.16 /-126.38/ /-83.44 -23.09/-2.03 7 [bos] you do seem somewhat tattered [eos] tgt4: mod/noi/dif/loss/nce/logp -86.68 /-11.49 /-75.19 / /-32.25 -12.38/-1.64 8 [bos] you do seem somewhat tattered . [eos] tgt5: mod/noi/dif/loss/nce/logp -79.76 /-11.97 /-67.79 / /-24.85 -8.86 /-1.33 10 [bos] you do seem somewhat tattered '' . . [eos] cls0 - sp0 : -4.80 -1.20 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -7.45 -1.49 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -7.47 -1.87 5 0.00 [bos] she ! ! [eos] cls0 - sp3 : -7.59 -1.90 5 0.00 [bos] 7 ! ! [eos] cls0 - sp4 : -7.73 -1.93 5 0.00 [bos] we ! ! [eos] cls1 - sp0 : -4.34 -1.08 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -4.99 -1.25 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -5.52 -1.38 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -6.70 -1.34 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -7.17 -1.43 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -4.40 -1.10 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -4.62 -1.16 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -4.85 -1.21 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -6.29 -1.26 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -6.40 -1.60 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -3.63 -0.91 5 1.00 [bos] ! ! ! [eos] cls3 - sp1 : -3.77 -0.94 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -5.38 -1.34 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -5.46 -1.37 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -5.55 -1.39 5 0.75 [bos] ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-139 src: none none 9 [bos] you do seem somewhat tattered '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.97 /-0.79 /-51.18 /0.69/-0.69 -6.50 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.97 /-0.79 /-51.18 / /-0.69 -6.50 /-0.10 9 [bos] you do seem somewhat tattered '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -84.57 /-11.68 /-72.90 / /-22.41 -12.08/-1.67 8 [bos] you do seem somewhat tattered '' [eos] tgt3: mod/noi/dif/loss/nce/logp -140.08/-12.16 /-127.92/ /-77.44 -23.35/-2.03 7 [bos] you do seem somewhat tattered [eos] tgt4: mod/noi/dif/loss/nce/logp -93.63 /-11.49 /-82.14 / /-31.66 -13.38/-1.64 8 [bos] you do seem somewhat tattered . [eos] tgt5: mod/noi/dif/loss/nce/logp -89.99 /-11.97 /-78.02 / /-27.53 -10.00/-1.33 10 [bos] you do seem somewhat tattered '' . . [eos] cls0 - sp0 : -4.80 -1.20 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -7.45 -1.49 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -7.47 -1.87 5 0.00 [bos] she ! ! [eos] cls0 - sp3 : -7.59 -1.90 5 0.00 [bos] 7 ! ! [eos] cls0 - sp4 : -7.73 -1.93 5 0.00 [bos] we ! ! [eos] cls1 - sp0 : -4.34 -1.08 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -4.99 -1.25 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -5.52 -1.38 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -6.70 -1.34 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -7.17 -1.43 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -4.40 -1.10 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -4.62 -1.16 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -4.85 -1.21 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -6.29 -1.26 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -6.40 -1.60 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -3.63 -0.91 5 1.00 [bos] ! ! ! [eos] cls3 - sp1 : -3.77 -0.94 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -5.38 -1.34 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -5.46 -1.37 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -5.55 -1.39 5 0.75 [bos] ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-140 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -16.36 /-0.97 /-15.39 /0.69/-0.69 -2.05 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -16.36 /-0.97 /-15.39 / /-0.69 -2.05 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -49.61 /-11.81 /-37.80 / /-23.10 -7.09 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -41.30 /-12.02 /-29.27 / /-14.58 -5.16 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -37.94 /-12.09 /-25.84 / /-11.15 -4.74 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -38.14 /-11.98 /-26.16 / /-11.47 -4.77 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.61 -1.08 9 0.00 [bos] she in a no , i . [eos] cls0 - sp1 : -8.68 -1.08 9 0.00 [bos] when in a no , i . [eos] cls0 - sp2 : -8.91 -1.11 9 0.00 [bos] when in a no , she . [eos] cls0 - sp3 : -9.05 -1.13 9 0.00 [bos] she in a no , she . [eos] cls0 - sp4 : -9.21 -1.15 9 0.00 [bos] she in a any , i . [eos] cls1 - sp0 : -10.75 -1.34 9 0.25 [bos] when in a ! , she . [eos] cls1 - sp1 : -10.92 -1.36 9 0.25 [bos] she in a ! , she . [eos] cls1 - sp2 : -10.92 -1.37 9 0.25 [bos] she in a ! , ! . [eos] cls1 - sp3 : -10.99 -1.37 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp4 : -11.31 -1.41 9 0.25 [bos] when in a ! , don't . [eos] cls2 - sp0 : -12.29 -1.54 9 0.62 [bos] ! in a ! , she . [eos] cls2 - sp1 : -12.42 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp2 : -12.43 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp3 : -12.46 -1.56 9 0.50 [bos] when in a no , she . [eos] cls2 - sp4 : -12.60 -1.57 9 0.50 [bos] ! in a no , she . [eos] cls3 - sp0 : -8.54 -1.07 9 0.88 [bos] she in a no , she . [eos] cls3 - sp1 : -8.57 -1.07 9 0.88 [bos] she in a no , don't . [eos] cls3 - sp2 : -9.01 -1.13 9 0.88 [bos] she in a later , she . [eos] cls3 - sp3 : -9.05 -1.13 9 0.88 [bos] she in a later , don't . [eos] cls3 - sp4 : -9.09 -1.14 9 1.00 [bos] she in a no , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-141 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -18.38 /-0.97 /-17.41 /0.69/-0.69 -2.30 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -18.38 /-0.97 /-17.41 / /-0.69 -2.30 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.57 /-11.81 /-43.76 / /-27.04 -7.94 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -43.53 /-12.02 /-31.50 / /-14.79 -5.44 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -41.72 /-12.09 /-29.63 / /-12.91 -5.22 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -38.85 /-11.98 /-26.87 / /-10.15 -4.86 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.61 -1.08 9 0.00 [bos] she in a no , i . [eos] cls0 - sp1 : -8.68 -1.08 9 0.00 [bos] when in a no , i . [eos] cls0 - sp2 : -8.91 -1.11 9 0.00 [bos] when in a no , she . [eos] cls0 - sp3 : -9.05 -1.13 9 0.00 [bos] she in a no , she . [eos] cls0 - sp4 : -9.21 -1.15 9 0.00 [bos] she in a any , i . [eos] cls1 - sp0 : -10.75 -1.34 9 0.25 [bos] when in a ! , she . [eos] cls1 - sp1 : -10.92 -1.36 9 0.25 [bos] she in a ! , she . [eos] cls1 - sp2 : -10.92 -1.37 9 0.25 [bos] she in a ! , ! . [eos] cls1 - sp3 : -10.99 -1.37 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp4 : -11.31 -1.41 9 0.25 [bos] when in a ! , don't . [eos] cls2 - sp0 : -12.29 -1.54 9 0.62 [bos] ! in a ! , she . [eos] cls2 - sp1 : -12.42 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp2 : -12.43 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp3 : -12.46 -1.56 9 0.50 [bos] when in a no , she . [eos] cls2 - sp4 : -12.60 -1.57 9 0.50 [bos] ! in a no , she . [eos] cls3 - sp0 : -8.54 -1.07 9 0.88 [bos] she in a no , she . [eos] cls3 - sp1 : -8.57 -1.07 9 0.88 [bos] she in a no , don't . [eos] cls3 - sp2 : -9.01 -1.13 9 0.88 [bos] she in a later , she . [eos] cls3 - sp3 : -9.05 -1.13 9 0.88 [bos] she in a later , don't . [eos] cls3 - sp4 : -9.09 -1.14 9 1.00 [bos] she in a no , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-142 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -15.79 /-0.97 /-14.81 /0.69/-0.69 -1.97 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -15.79 /-0.97 /-14.81 / /-0.69 -1.97 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -49.00 /-11.81 /-37.19 / /-23.07 -7.00 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -41.03 /-12.02 /-29.00 / /-14.89 -5.13 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -38.91 /-12.09 /-26.81 / /-12.69 -4.86 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.75 /-11.98 /-23.78 / /-9.66 -4.47 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.35 -1.04 9 0.00 [bos] when in a no , no . [eos] cls0 - sp1 : -8.59 -1.07 9 0.00 [bos] when in a any , no . [eos] cls0 - sp2 : -8.66 -1.08 9 0.00 [bos] when in a all , no . [eos] cls0 - sp3 : -8.74 -1.09 9 0.00 [bos] when in a i , no . [eos] cls0 - sp4 : -8.79 -1.10 9 0.00 [bos] she in a no , no . [eos] cls1 - sp0 : -9.36 -1.17 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp1 : -10.49 -1.31 9 0.38 [bos] ! in a ! , ! . [eos] cls1 - sp2 : -10.71 -1.34 9 0.25 [bos] when in a ! , no . [eos] cls1 - sp3 : -10.77 -1.35 9 0.38 [bos] ! with a ! , ! . [eos] cls1 - sp4 : -10.78 -1.35 9 0.25 [bos] ! in a ! , ! . [eos] cls2 - sp0 : -11.36 -1.42 9 0.50 [bos] ! in a no , ! . [eos] cls2 - sp1 : -11.70 -1.46 9 0.50 [bos] ! in a ! , ! . [eos] cls2 - sp2 : -11.71 -1.46 9 0.50 [bos] when in a no , ! . [eos] cls2 - sp3 : -11.91 -1.49 9 0.50 [bos] ! in a no , no . [eos] cls2 - sp4 : -12.19 -1.52 9 0.62 [bos] ! in a ! , no . [eos] cls3 - sp0 : -8.39 -1.05 9 0.88 [bos] she in a no , no . [eos] cls3 - sp1 : -8.64 -1.08 9 0.88 [bos] when in a no , no . [eos] cls3 - sp2 : -8.74 -1.09 9 0.88 [bos] she in a later , no . [eos] cls3 - sp3 : -8.88 -1.11 9 0.88 [bos] she in a no , ! . [eos] cls3 - sp4 : -9.05 -1.13 9 0.88 [bos] when in a we , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-143 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -17.01 /-0.97 /-16.04 /0.69/-0.69 -2.13 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -17.01 /-0.97 /-16.04 / /-0.69 -2.13 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -54.48 /-11.81 /-42.67 / /-27.32 -7.78 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -42.54 /-12.02 /-30.51 / /-15.17 -5.32 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -41.26 /-12.09 /-29.17 / /-13.82 -5.16 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.81 /-11.98 /-23.83 / /-8.49 -4.48 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.35 -1.04 9 0.00 [bos] when in a no , no . [eos] cls0 - sp1 : -8.59 -1.07 9 0.00 [bos] when in a any , no . [eos] cls0 - sp2 : -8.66 -1.08 9 0.00 [bos] when in a all , no . [eos] cls0 - sp3 : -8.74 -1.09 9 0.00 [bos] when in a i , no . [eos] cls0 - sp4 : -8.79 -1.10 9 0.00 [bos] she in a no , no . [eos] cls1 - sp0 : -9.36 -1.17 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp1 : -10.49 -1.31 9 0.38 [bos] ! in a ! , ! . [eos] cls1 - sp2 : -10.71 -1.34 9 0.25 [bos] when in a ! , no . [eos] cls1 - sp3 : -10.77 -1.35 9 0.38 [bos] ! with a ! , ! . [eos] cls1 - sp4 : -10.78 -1.35 9 0.25 [bos] ! in a ! , ! . [eos] cls2 - sp0 : -11.36 -1.42 9 0.50 [bos] ! in a no , ! . [eos] cls2 - sp1 : -11.70 -1.46 9 0.50 [bos] ! in a ! , ! . [eos] cls2 - sp2 : -11.71 -1.46 9 0.50 [bos] when in a no , ! . [eos] cls2 - sp3 : -11.91 -1.49 9 0.50 [bos] ! in a no , no . [eos] cls2 - sp4 : -12.19 -1.52 9 0.62 [bos] ! in a ! , no . [eos] cls3 - sp0 : -8.39 -1.05 9 0.88 [bos] she in a no , no . [eos] cls3 - sp1 : -8.64 -1.08 9 0.88 [bos] when in a no , no . [eos] cls3 - sp2 : -8.74 -1.09 9 0.88 [bos] she in a later , no . [eos] cls3 - sp3 : -8.88 -1.11 9 0.88 [bos] she in a no , ! . [eos] cls3 - sp4 : -9.05 -1.13 9 0.88 [bos] when in a we , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-144 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -16.36 /-0.97 /-15.39 /0.69/-0.69 -2.05 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -16.36 /-0.97 /-15.39 / /-0.69 -2.05 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -49.61 /-11.81 /-37.80 / /-23.10 -7.09 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -41.30 /-12.02 /-29.27 / /-14.58 -5.16 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -37.94 /-12.09 /-25.84 / /-11.15 -4.74 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -38.14 /-11.98 /-26.16 / /-11.47 -4.77 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.61 -1.08 9 0.00 [bos] she in a no , i . [eos] cls0 - sp1 : -8.68 -1.08 9 0.00 [bos] when in a no , i . [eos] cls0 - sp2 : -8.91 -1.11 9 0.00 [bos] when in a no , she . [eos] cls0 - sp3 : -9.05 -1.13 9 0.00 [bos] she in a no , she . [eos] cls0 - sp4 : -9.21 -1.15 9 0.00 [bos] she in a any , i . [eos] cls1 - sp0 : -10.75 -1.34 9 0.25 [bos] when in a ! , she . [eos] cls1 - sp1 : -10.92 -1.36 9 0.25 [bos] she in a ! , she . [eos] cls1 - sp2 : -10.92 -1.37 9 0.25 [bos] she in a ! , ! . [eos] cls1 - sp3 : -10.99 -1.37 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp4 : -11.31 -1.41 9 0.25 [bos] when in a ! , don't . [eos] cls2 - sp0 : -12.29 -1.54 9 0.62 [bos] ! in a ! , she . [eos] cls2 - sp1 : -12.42 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp2 : -12.43 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp3 : -12.46 -1.56 9 0.50 [bos] when in a no , she . [eos] cls2 - sp4 : -12.60 -1.57 9 0.50 [bos] ! in a no , she . [eos] cls3 - sp0 : -8.54 -1.07 9 0.88 [bos] she in a no , she . [eos] cls3 - sp1 : -8.57 -1.07 9 0.88 [bos] she in a no , don't . [eos] cls3 - sp2 : -9.01 -1.13 9 0.88 [bos] she in a later , she . [eos] cls3 - sp3 : -9.05 -1.13 9 0.88 [bos] she in a later , don't . [eos] cls3 - sp4 : -9.09 -1.14 9 1.00 [bos] she in a no , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-145 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -18.38 /-0.97 /-17.41 /0.69/-0.69 -2.30 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -18.38 /-0.97 /-17.41 / /-0.69 -2.30 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.57 /-11.81 /-43.76 / /-27.04 -7.94 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -43.53 /-12.02 /-31.50 / /-14.79 -5.44 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -41.72 /-12.09 /-29.63 / /-12.91 -5.22 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -38.85 /-11.98 /-26.87 / /-10.15 -4.86 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.61 -1.08 9 0.00 [bos] she in a no , i . [eos] cls0 - sp1 : -8.68 -1.08 9 0.00 [bos] when in a no , i . [eos] cls0 - sp2 : -8.91 -1.11 9 0.00 [bos] when in a no , she . [eos] cls0 - sp3 : -9.05 -1.13 9 0.00 [bos] she in a no , she . [eos] cls0 - sp4 : -9.21 -1.15 9 0.00 [bos] she in a any , i . [eos] cls1 - sp0 : -10.75 -1.34 9 0.25 [bos] when in a ! , she . [eos] cls1 - sp1 : -10.92 -1.36 9 0.25 [bos] she in a ! , she . [eos] cls1 - sp2 : -10.92 -1.37 9 0.25 [bos] she in a ! , ! . [eos] cls1 - sp3 : -10.99 -1.37 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp4 : -11.31 -1.41 9 0.25 [bos] when in a ! , don't . [eos] cls2 - sp0 : -12.29 -1.54 9 0.62 [bos] ! in a ! , she . [eos] cls2 - sp1 : -12.42 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp2 : -12.43 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp3 : -12.46 -1.56 9 0.50 [bos] when in a no , she . [eos] cls2 - sp4 : -12.60 -1.57 9 0.50 [bos] ! in a no , she . [eos] cls3 - sp0 : -8.54 -1.07 9 0.88 [bos] she in a no , she . [eos] cls3 - sp1 : -8.57 -1.07 9 0.88 [bos] she in a no , don't . [eos] cls3 - sp2 : -9.01 -1.13 9 0.88 [bos] she in a later , she . [eos] cls3 - sp3 : -9.05 -1.13 9 0.88 [bos] she in a later , don't . [eos] cls3 - sp4 : -9.09 -1.14 9 1.00 [bos] she in a no , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-146 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -15.79 /-0.97 /-14.81 /0.69/-0.69 -1.97 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -15.79 /-0.97 /-14.81 / /-0.69 -1.97 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -49.00 /-11.81 /-37.19 / /-23.07 -7.00 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -41.03 /-12.02 /-29.00 / /-14.89 -5.13 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -38.91 /-12.09 /-26.81 / /-12.69 -4.86 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.75 /-11.98 /-23.78 / /-9.66 -4.47 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.35 -1.04 9 0.00 [bos] when in a no , no . [eos] cls0 - sp1 : -8.59 -1.07 9 0.00 [bos] when in a any , no . [eos] cls0 - sp2 : -8.66 -1.08 9 0.00 [bos] when in a all , no . [eos] cls0 - sp3 : -8.74 -1.09 9 0.00 [bos] when in a i , no . [eos] cls0 - sp4 : -8.79 -1.10 9 0.00 [bos] she in a no , no . [eos] cls1 - sp0 : -9.36 -1.17 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp1 : -10.49 -1.31 9 0.38 [bos] ! in a ! , ! . [eos] cls1 - sp2 : -10.71 -1.34 9 0.25 [bos] when in a ! , no . [eos] cls1 - sp3 : -10.77 -1.35 9 0.38 [bos] ! with a ! , ! . [eos] cls1 - sp4 : -10.78 -1.35 9 0.25 [bos] ! in a ! , ! . [eos] cls2 - sp0 : -11.36 -1.42 9 0.50 [bos] ! in a no , ! . [eos] cls2 - sp1 : -11.70 -1.46 9 0.50 [bos] ! in a ! , ! . [eos] cls2 - sp2 : -11.71 -1.46 9 0.50 [bos] when in a no , ! . [eos] cls2 - sp3 : -11.91 -1.49 9 0.50 [bos] ! in a no , no . [eos] cls2 - sp4 : -12.19 -1.52 9 0.62 [bos] ! in a ! , no . [eos] cls3 - sp0 : -8.39 -1.05 9 0.88 [bos] she in a no , no . [eos] cls3 - sp1 : -8.64 -1.08 9 0.88 [bos] when in a no , no . [eos] cls3 - sp2 : -8.74 -1.09 9 0.88 [bos] she in a later , no . [eos] cls3 - sp3 : -8.88 -1.11 9 0.88 [bos] she in a no , ! . [eos] cls3 - sp4 : -9.05 -1.13 9 0.88 [bos] when in a we , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-147 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -17.01 /-0.97 /-16.04 /0.69/-0.69 -2.13 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -17.01 /-0.97 /-16.04 / /-0.69 -2.13 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -54.48 /-11.81 /-42.67 / /-27.32 -7.78 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -42.54 /-12.02 /-30.51 / /-15.17 -5.32 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -41.26 /-12.09 /-29.17 / /-13.82 -5.16 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.81 /-11.98 /-23.83 / /-8.49 -4.48 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.35 -1.04 9 0.00 [bos] when in a no , no . [eos] cls0 - sp1 : -8.59 -1.07 9 0.00 [bos] when in a any , no . [eos] cls0 - sp2 : -8.66 -1.08 9 0.00 [bos] when in a all , no . [eos] cls0 - sp3 : -8.74 -1.09 9 0.00 [bos] when in a i , no . [eos] cls0 - sp4 : -8.79 -1.10 9 0.00 [bos] she in a no , no . [eos] cls1 - sp0 : -9.36 -1.17 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp1 : -10.49 -1.31 9 0.38 [bos] ! in a ! , ! . [eos] cls1 - sp2 : -10.71 -1.34 9 0.25 [bos] when in a ! , no . [eos] cls1 - sp3 : -10.77 -1.35 9 0.38 [bos] ! with a ! , ! . [eos] cls1 - sp4 : -10.78 -1.35 9 0.25 [bos] ! in a ! , ! . [eos] cls2 - sp0 : -11.36 -1.42 9 0.50 [bos] ! in a no , ! . [eos] cls2 - sp1 : -11.70 -1.46 9 0.50 [bos] ! in a ! , ! . [eos] cls2 - sp2 : -11.71 -1.46 9 0.50 [bos] when in a no , ! . [eos] cls2 - sp3 : -11.91 -1.49 9 0.50 [bos] ! in a no , no . [eos] cls2 - sp4 : -12.19 -1.52 9 0.62 [bos] ! in a ! , no . [eos] cls3 - sp0 : -8.39 -1.05 9 0.88 [bos] she in a no , no . [eos] cls3 - sp1 : -8.64 -1.08 9 0.88 [bos] when in a no , no . [eos] cls3 - sp2 : -8.74 -1.09 9 0.88 [bos] she in a later , no . [eos] cls3 - sp3 : -8.88 -1.11 9 0.88 [bos] she in a no , ! . [eos] cls3 - sp4 : -9.05 -1.13 9 0.88 [bos] when in a we , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-148 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -16.36 /-0.97 /-15.39 /0.69/-0.69 -2.05 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -16.36 /-0.97 /-15.39 / /-0.69 -2.05 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -49.61 /-11.81 /-37.80 / /-23.10 -7.09 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -41.30 /-12.02 /-29.27 / /-14.58 -5.16 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -37.94 /-12.09 /-25.84 / /-11.15 -4.74 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -38.14 /-11.98 /-26.16 / /-11.47 -4.77 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.61 -1.08 9 0.00 [bos] she in a no , i . [eos] cls0 - sp1 : -8.68 -1.08 9 0.00 [bos] when in a no , i . [eos] cls0 - sp2 : -8.91 -1.11 9 0.00 [bos] when in a no , she . [eos] cls0 - sp3 : -9.05 -1.13 9 0.00 [bos] she in a no , she . [eos] cls0 - sp4 : -9.21 -1.15 9 0.00 [bos] she in a any , i . [eos] cls1 - sp0 : -10.75 -1.34 9 0.25 [bos] when in a ! , she . [eos] cls1 - sp1 : -10.92 -1.36 9 0.25 [bos] she in a ! , she . [eos] cls1 - sp2 : -10.92 -1.37 9 0.25 [bos] she in a ! , ! . [eos] cls1 - sp3 : -10.99 -1.37 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp4 : -11.31 -1.41 9 0.25 [bos] when in a ! , don't . [eos] cls2 - sp0 : -12.29 -1.54 9 0.62 [bos] ! in a ! , she . [eos] cls2 - sp1 : -12.42 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp2 : -12.43 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp3 : -12.46 -1.56 9 0.50 [bos] when in a no , she . [eos] cls2 - sp4 : -12.60 -1.57 9 0.50 [bos] ! in a no , she . [eos] cls3 - sp0 : -8.54 -1.07 9 0.88 [bos] she in a no , she . [eos] cls3 - sp1 : -8.57 -1.07 9 0.88 [bos] she in a no , don't . [eos] cls3 - sp2 : -9.01 -1.13 9 0.88 [bos] she in a later , she . [eos] cls3 - sp3 : -9.05 -1.13 9 0.88 [bos] she in a later , don't . [eos] cls3 - sp4 : -9.09 -1.14 9 1.00 [bos] she in a no , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-149 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -18.38 /-0.97 /-17.41 /0.69/-0.69 -2.30 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -18.38 /-0.97 /-17.41 / /-0.69 -2.30 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.57 /-11.81 /-43.76 / /-27.04 -7.94 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -43.53 /-12.02 /-31.50 / /-14.79 -5.44 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -41.72 /-12.09 /-29.63 / /-12.91 -5.22 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -38.85 /-11.98 /-26.87 / /-10.15 -4.86 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.61 -1.08 9 0.00 [bos] she in a no , i . [eos] cls0 - sp1 : -8.68 -1.08 9 0.00 [bos] when in a no , i . [eos] cls0 - sp2 : -8.91 -1.11 9 0.00 [bos] when in a no , she . [eos] cls0 - sp3 : -9.05 -1.13 9 0.00 [bos] she in a no , she . [eos] cls0 - sp4 : -9.21 -1.15 9 0.00 [bos] she in a any , i . [eos] cls1 - sp0 : -10.75 -1.34 9 0.25 [bos] when in a ! , she . [eos] cls1 - sp1 : -10.92 -1.36 9 0.25 [bos] she in a ! , she . [eos] cls1 - sp2 : -10.92 -1.37 9 0.25 [bos] she in a ! , ! . [eos] cls1 - sp3 : -10.99 -1.37 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp4 : -11.31 -1.41 9 0.25 [bos] when in a ! , don't . [eos] cls2 - sp0 : -12.29 -1.54 9 0.62 [bos] ! in a ! , she . [eos] cls2 - sp1 : -12.42 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp2 : -12.43 -1.55 9 0.62 [bos] ! in a no , she . [eos] cls2 - sp3 : -12.46 -1.56 9 0.50 [bos] when in a no , she . [eos] cls2 - sp4 : -12.60 -1.57 9 0.50 [bos] ! in a no , she . [eos] cls3 - sp0 : -8.54 -1.07 9 0.88 [bos] she in a no , she . [eos] cls3 - sp1 : -8.57 -1.07 9 0.88 [bos] she in a no , don't . [eos] cls3 - sp2 : -9.01 -1.13 9 0.88 [bos] she in a later , she . [eos] cls3 - sp3 : -9.05 -1.13 9 0.88 [bos] she in a later , don't . [eos] cls3 - sp4 : -9.09 -1.14 9 1.00 [bos] she in a no , she . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-150 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -15.79 /-0.97 /-14.81 /0.69/-0.69 -1.97 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -15.79 /-0.97 /-14.81 / /-0.69 -1.97 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -49.00 /-11.81 /-37.19 / /-23.07 -7.00 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -41.03 /-12.02 /-29.00 / /-14.89 -5.13 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -38.91 /-12.09 /-26.81 / /-12.69 -4.86 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.75 /-11.98 /-23.78 / /-9.66 -4.47 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.35 -1.04 9 0.00 [bos] when in a no , no . [eos] cls0 - sp1 : -8.59 -1.07 9 0.00 [bos] when in a any , no . [eos] cls0 - sp2 : -8.66 -1.08 9 0.00 [bos] when in a all , no . [eos] cls0 - sp3 : -8.74 -1.09 9 0.00 [bos] when in a i , no . [eos] cls0 - sp4 : -8.79 -1.10 9 0.00 [bos] she in a no , no . [eos] cls1 - sp0 : -9.36 -1.17 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp1 : -10.49 -1.31 9 0.38 [bos] ! in a ! , ! . [eos] cls1 - sp2 : -10.71 -1.34 9 0.25 [bos] when in a ! , no . [eos] cls1 - sp3 : -10.77 -1.35 9 0.38 [bos] ! with a ! , ! . [eos] cls1 - sp4 : -10.78 -1.35 9 0.25 [bos] ! in a ! , ! . [eos] cls2 - sp0 : -11.36 -1.42 9 0.50 [bos] ! in a no , ! . [eos] cls2 - sp1 : -11.70 -1.46 9 0.50 [bos] ! in a ! , ! . [eos] cls2 - sp2 : -11.71 -1.46 9 0.50 [bos] when in a no , ! . [eos] cls2 - sp3 : -11.91 -1.49 9 0.50 [bos] ! in a no , no . [eos] cls2 - sp4 : -12.19 -1.52 9 0.62 [bos] ! in a ! , no . [eos] cls3 - sp0 : -8.39 -1.05 9 0.88 [bos] she in a no , no . [eos] cls3 - sp1 : -8.64 -1.08 9 0.88 [bos] when in a no , no . [eos] cls3 - sp2 : -8.74 -1.09 9 0.88 [bos] she in a later , no . [eos] cls3 - sp3 : -8.88 -1.11 9 0.88 [bos] she in a no , ! . [eos] cls3 - sp4 : -9.05 -1.13 9 0.88 [bos] when in a we , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-151 src: none none 9 [bos] `` in a way , yes . [eos] tgt0: mod/noi/dif/loss/nce/logp -17.01 /-0.97 /-16.04 /0.69/-0.69 -2.13 /-0.12 9 [bos] `` in a way , yes . [eos] tgt1: mod/noi/dif/loss/nce/logp -17.01 /-0.97 /-16.04 / /-0.69 -2.13 /-0.12 9 [bos] `` in a way , yes . [eos] tgt2: mod/noi/dif/loss/nce/logp -54.48 /-11.81 /-42.67 / /-27.32 -7.78 /-1.69 8 [bos] `` in a way , yes [eos] tgt3: mod/noi/dif/loss/nce/logp -42.54 /-12.02 /-30.51 / /-15.17 -5.32 /-1.50 9 [bos] `` in the way , yes . [eos] tgt4: mod/noi/dif/loss/nce/logp -41.26 /-12.09 /-29.17 / /-13.82 -5.16 /-1.51 9 [bos] `` of a way , yes . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.81 /-11.98 /-23.83 / /-8.49 -4.48 /-1.50 9 [bos] a in a way , yes . [eos] cls0 - sp0 : -8.35 -1.04 9 0.00 [bos] when in a no , no . [eos] cls0 - sp1 : -8.59 -1.07 9 0.00 [bos] when in a any , no . [eos] cls0 - sp2 : -8.66 -1.08 9 0.00 [bos] when in a all , no . [eos] cls0 - sp3 : -8.74 -1.09 9 0.00 [bos] when in a i , no . [eos] cls0 - sp4 : -8.79 -1.10 9 0.00 [bos] she in a no , no . [eos] cls1 - sp0 : -9.36 -1.17 9 0.25 [bos] when in a ! , ! . [eos] cls1 - sp1 : -10.49 -1.31 9 0.38 [bos] ! in a ! , ! . [eos] cls1 - sp2 : -10.71 -1.34 9 0.25 [bos] when in a ! , no . [eos] cls1 - sp3 : -10.77 -1.35 9 0.38 [bos] ! with a ! , ! . [eos] cls1 - sp4 : -10.78 -1.35 9 0.25 [bos] ! in a ! , ! . [eos] cls2 - sp0 : -11.36 -1.42 9 0.50 [bos] ! in a no , ! . [eos] cls2 - sp1 : -11.70 -1.46 9 0.50 [bos] ! in a ! , ! . [eos] cls2 - sp2 : -11.71 -1.46 9 0.50 [bos] when in a no , ! . [eos] cls2 - sp3 : -11.91 -1.49 9 0.50 [bos] ! in a no , no . [eos] cls2 - sp4 : -12.19 -1.52 9 0.62 [bos] ! in a ! , no . [eos] cls3 - sp0 : -8.39 -1.05 9 0.88 [bos] she in a no , no . [eos] cls3 - sp1 : -8.64 -1.08 9 0.88 [bos] when in a no , no . [eos] cls3 - sp2 : -8.74 -1.09 9 0.88 [bos] she in a later , no . [eos] cls3 - sp3 : -8.88 -1.11 9 0.88 [bos] she in a no , ! . [eos] cls3 - sp4 : -9.05 -1.13 9 0.88 [bos] when in a we , no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-152 src: none none 13 [bos] he was mad about stars at the age of nine . [eos] tgt0: mod/noi/dif/loss/nce/logp -48.03 /-1.26 /-46.77 /0.69/-0.69 -4.00 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt1: mod/noi/dif/loss/nce/logp -48.03 /-1.26 /-46.77 / /-0.69 -4.00 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt2: mod/noi/dif/loss/nce/logp -77.86 /-12.18 /-65.68 / /-19.60 -7.08 /-1.11 12 [bos] he was mad about stars at the age of nine [eos] tgt3: mod/noi/dif/loss/nce/logp -85.82 /-12.43 /-73.39 / /-27.31 -6.60 /-0.96 14 [bos] he was mad about stars at the age of nine . . [eos] tgt4: mod/noi/dif/loss/nce/logp -67.54 /-12.80 /-54.74 / /-8.67 -5.63 /-1.07 13 [bos] he was mad about stars close the age of nine . [eos] tgt5: mod/noi/dif/loss/nce/logp -182.02/-12.38 /-169.64/ /-123.57 -91.01/-6.19 3 [bos] he [eos] cls0 - sp0 : -9.96 -1.99 6 0.20 [bos] ! was ! ! [eos] cls0 - sp1 : -22.56 -1.88 13 0.00 [bos] i was joined about deck at the any of be . [eos] cls0 - sp2 : -22.58 -1.88 13 0.00 [bos] i was joined about deck at the later of be . [eos] cls0 - sp3 : -22.63 -1.89 13 0.00 [bos] i was joined about deck at the later of joined . [eos] cls0 - sp4 : -22.67 -1.89 13 0.00 [bos] i was joined about deck at the any of joined . [eos] cls1 - sp0 : -10.76 -2.15 6 0.40 [bos] ! was ! ! [eos] cls1 - sp1 : -10.96 -2.19 6 0.40 [bos] ! was ! ! [eos] cls1 - sp2 : -11.27 -2.25 6 0.40 [bos] ! was ! ; [eos] cls1 - sp3 : -11.28 -2.26 6 0.40 [bos] ! was joined ! [eos] cls1 - sp4 : -14.31 -2.86 6 0.40 [bos] ! was ! ! [eos] cls2 - sp0 : -13.91 -2.78 6 0.60 [bos] ! was ! ; [eos] cls2 - sp1 : -14.45 -2.89 6 0.60 [bos] ! was ! ! [eos] cls2 - sp2 : -14.75 -2.95 6 0.60 [bos] ! was ! ! [eos] cls2 - sp3 : -16.32 -3.26 6 0.60 [bos] ! was joined ! [eos] cls2 - sp4 : -31.26 -2.60 13 0.50 [bos] ! was ! about ! at the later of don't . [eos] cls3 - sp0 : -22.73 -1.89 13 1.00 [bos] we was personal about crime at the later of made . [eos] cls3 - sp1 : -22.86 -1.91 13 1.00 [bos] we was personal about streets at the later of made . [eos] cls3 - sp2 : -22.94 -1.91 13 1.00 [bos] she was personal about crime at the later of made . [eos] cls3 - sp3 : -22.97 -1.91 13 1.00 [bos] we was personal about state at the later of made . [eos] cls3 - sp4 : -23.01 -1.92 13 1.00 [bos] we was personal about crime at the later of be . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-153 src: none none 13 [bos] he was mad about stars at the age of nine . [eos] tgt0: mod/noi/dif/loss/nce/logp -50.82 /-1.26 /-49.56 /0.69/-0.69 -4.24 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt1: mod/noi/dif/loss/nce/logp -50.82 /-1.26 /-49.56 / /-0.69 -4.24 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.20 /-12.18 /-74.02 / /-25.16 -7.84 /-1.11 12 [bos] he was mad about stars at the age of nine [eos] tgt3: mod/noi/dif/loss/nce/logp -89.27 /-12.43 /-76.84 / /-27.98 -6.87 /-0.96 14 [bos] he was mad about stars at the age of nine . . [eos] tgt4: mod/noi/dif/loss/nce/logp -69.93 /-12.80 /-57.13 / /-8.26 -5.83 /-1.07 13 [bos] he was mad about stars close the age of nine . [eos] tgt5: mod/noi/dif/loss/nce/logp -175.23/-12.38 /-162.85/ /-113.98 -87.61/-6.19 3 [bos] he [eos] cls0 - sp0 : -9.96 -1.99 6 0.20 [bos] ! was ! ! [eos] cls0 - sp1 : -22.56 -1.88 13 0.00 [bos] i was joined about deck at the any of be . [eos] cls0 - sp2 : -22.58 -1.88 13 0.00 [bos] i was joined about deck at the later of be . [eos] cls0 - sp3 : -22.63 -1.89 13 0.00 [bos] i was joined about deck at the later of joined . [eos] cls0 - sp4 : -22.67 -1.89 13 0.00 [bos] i was joined about deck at the any of joined . [eos] cls1 - sp0 : -10.76 -2.15 6 0.40 [bos] ! was ! ! [eos] cls1 - sp1 : -10.96 -2.19 6 0.40 [bos] ! was ! ! [eos] cls1 - sp2 : -11.27 -2.25 6 0.40 [bos] ! was ! ; [eos] cls1 - sp3 : -11.28 -2.26 6 0.40 [bos] ! was joined ! [eos] cls1 - sp4 : -14.31 -2.86 6 0.40 [bos] ! was ! ! [eos] cls2 - sp0 : -13.91 -2.78 6 0.60 [bos] ! was ! ; [eos] cls2 - sp1 : -14.45 -2.89 6 0.60 [bos] ! was ! ! [eos] cls2 - sp2 : -14.75 -2.95 6 0.60 [bos] ! was ! ! [eos] cls2 - sp3 : -16.32 -3.26 6 0.60 [bos] ! was joined ! [eos] cls2 - sp4 : -31.26 -2.60 13 0.50 [bos] ! was ! about ! at the later of don't . [eos] cls3 - sp0 : -22.73 -1.89 13 1.00 [bos] we was personal about crime at the later of made . [eos] cls3 - sp1 : -22.86 -1.91 13 1.00 [bos] we was personal about streets at the later of made . [eos] cls3 - sp2 : -22.94 -1.91 13 1.00 [bos] she was personal about crime at the later of made . [eos] cls3 - sp3 : -22.97 -1.91 13 1.00 [bos] we was personal about state at the later of made . [eos] cls3 - sp4 : -23.01 -1.92 13 1.00 [bos] we was personal about crime at the later of be . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-154 src: none none 13 [bos] he was mad about stars at the age of nine . [eos] tgt0: mod/noi/dif/loss/nce/logp -50.93 /-1.26 /-49.67 /0.69/-0.69 -4.24 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt1: mod/noi/dif/loss/nce/logp -50.93 /-1.26 /-49.67 / /-0.69 -4.24 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt2: mod/noi/dif/loss/nce/logp -77.65 /-12.18 /-65.47 / /-16.49 -7.06 /-1.11 12 [bos] he was mad about stars at the age of nine [eos] tgt3: mod/noi/dif/loss/nce/logp -87.49 /-12.43 /-75.06 / /-26.09 -6.73 /-0.96 14 [bos] he was mad about stars at the age of nine . . [eos] tgt4: mod/noi/dif/loss/nce/logp -69.61 /-12.80 /-56.81 / /-7.83 -5.80 /-1.07 13 [bos] he was mad about stars close the age of nine . [eos] tgt5: mod/noi/dif/loss/nce/logp -138.99/-12.38 /-126.61/ /-77.63 -69.50/-6.19 3 [bos] he [eos] cls0 - sp0 : -21.03 -1.75 13 0.00 [bos] she was joined about ! at the any of ! . [eos] cls0 - sp1 : -21.07 -1.76 13 0.00 [bos] she was joined about ! at the ) of ! . [eos] cls0 - sp2 : -21.17 -1.76 13 0.00 [bos] she was joined about joined at the any of ! . [eos] cls0 - sp3 : -21.19 -1.77 13 0.00 [bos] i was joined about joined at the any of first . [eos] cls0 - sp4 : -21.20 -1.77 13 0.00 [bos] she was joined about joined at the any of first . [eos] cls1 - sp0 : -22.49 -1.87 13 0.25 [bos] she was don't about telephone at the ) of ! . [eos] cls1 - sp1 : -22.63 -1.89 13 0.25 [bos] she was she about telephone at the ) of ! . [eos] cls1 - sp2 : -22.74 -1.90 13 0.25 [bos] she was 7 about telephone at the ) of ! . [eos] cls1 - sp3 : -22.83 -1.90 13 0.25 [bos] we was don't about telephone at the ) of ! . [eos] cls1 - sp4 : -22.98 -1.92 13 0.25 [bos] she was don't about telephone at the any of ! . [eos] cls2 - sp0 : -25.73 -2.14 13 0.50 [bos] she was she about telephone at the ) of ! . [eos] cls2 - sp1 : -28.73 -2.39 13 0.58 [bos] she was she about telephone at the ) of ! . [eos] cls2 - sp2 : -29.69 -2.47 13 0.50 [bos] she was she about telephone at the ) of ! . [eos] cls2 - sp3 : -29.95 -2.50 13 0.50 [bos] she was she about telephone at the take of ! . [eos] cls2 - sp4 : -30.06 -2.50 13 0.58 [bos] she was she about telephone at the ) of ! . [eos] cls3 - sp0 : -21.52 -1.79 13 1.00 [bos] she was don't about telephone at the later of personal . [eos] cls3 - sp1 : -21.57 -1.80 13 1.00 [bos] she was telephone about telephone at the later of personal . [eos] cls3 - sp2 : -21.57 -1.80 13 1.00 [bos] she was corner about telephone at the later of don't . [eos] cls3 - sp3 : -21.57 -1.80 13 1.00 [bos] she was corner about telephone at the later of personal . [eos] cls3 - sp4 : -21.68 -1.81 13 1.00 [bos] she was don't about telephone at the personal of personal . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-155 src: none none 13 [bos] he was mad about stars at the age of nine . [eos] tgt0: mod/noi/dif/loss/nce/logp -52.27 /-1.26 /-51.01 /0.69/-0.69 -4.36 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt1: mod/noi/dif/loss/nce/logp -52.27 /-1.26 /-51.01 / /-0.69 -4.36 /-0.11 13 [bos] he was mad about stars at the age of nine . [eos] tgt2: mod/noi/dif/loss/nce/logp -83.46 /-12.18 /-71.28 / /-20.97 -7.59 /-1.11 12 [bos] he was mad about stars at the age of nine [eos] tgt3: mod/noi/dif/loss/nce/logp -90.14 /-12.43 /-77.72 / /-27.40 -6.93 /-0.96 14 [bos] he was mad about stars at the age of nine . . [eos] tgt4: mod/noi/dif/loss/nce/logp -72.08 /-12.80 /-59.28 / /-8.97 -6.01 /-1.07 13 [bos] he was mad about stars close the age of nine . [eos] tgt5: mod/noi/dif/loss/nce/logp -130.81/-12.38 /-118.43/ /-68.11 -65.40/-6.19 3 [bos] he [eos] cls0 - sp0 : -21.03 -1.75 13 0.00 [bos] she was joined about ! at the any of ! . [eos] cls0 - sp1 : -21.07 -1.76 13 0.00 [bos] she was joined about ! at the ) of ! . [eos] cls0 - sp2 : -21.17 -1.76 13 0.00 [bos] she was joined about joined at the any of ! . [eos] cls0 - sp3 : -21.19 -1.77 13 0.00 [bos] i was joined about joined at the any of first . [eos] cls0 - sp4 : -21.20 -1.77 13 0.00 [bos] she was joined about joined at the any of first . [eos] cls1 - sp0 : -22.49 -1.87 13 0.25 [bos] she was don't about telephone at the ) of ! . [eos] cls1 - sp1 : -22.63 -1.89 13 0.25 [bos] she was she about telephone at the ) of ! . [eos] cls1 - sp2 : -22.74 -1.90 13 0.25 [bos] she was 7 about telephone at the ) of ! . [eos] cls1 - sp3 : -22.83 -1.90 13 0.25 [bos] we was don't about telephone at the ) of ! . [eos] cls1 - sp4 : -22.98 -1.92 13 0.25 [bos] she was don't about telephone at the any of ! . [eos] cls2 - sp0 : -25.73 -2.14 13 0.50 [bos] she was she about telephone at the ) of ! . [eos] cls2 - sp1 : -28.73 -2.39 13 0.58 [bos] she was she about telephone at the ) of ! . [eos] cls2 - sp2 : -29.69 -2.47 13 0.50 [bos] she was she about telephone at the ) of ! . [eos] cls2 - sp3 : -29.95 -2.50 13 0.50 [bos] she was she about telephone at the take of ! . [eos] cls2 - sp4 : -30.06 -2.50 13 0.58 [bos] she was she about telephone at the ) of ! . [eos] cls3 - sp0 : -21.52 -1.79 13 1.00 [bos] she was don't about telephone at the later of personal . [eos] cls3 - sp1 : -21.57 -1.80 13 1.00 [bos] she was telephone about telephone at the later of personal . [eos] cls3 - sp2 : -21.57 -1.80 13 1.00 [bos] she was corner about telephone at the later of don't . [eos] cls3 - sp3 : -21.57 -1.80 13 1.00 [bos] she was corner about telephone at the later of personal . [eos] cls3 - sp4 : -21.68 -1.81 13 1.00 [bos] she was don't about telephone at the personal of personal . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-156 src: none none 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -78.81 /-1.64 /-77.17 /8.42/-8.42 -4.64 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -78.81 /-1.64 /-77.17 / /-8.42 -4.64 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -101.88/-13.48 /-88.40 / /-19.65 -5.99 /-0.79 18 [bos] `` but he plays bass with chief crazy horse and fifty five colts '' ! ! [eos] tgt3: mod/noi/dif/loss/nce/logp -190.97/-12.38 /-178.59/ /-109.84 -12.73/-0.83 16 [bos] `` but he plays bass with chief crazy horse and his five colts . [eos] tgt4: mod/noi/dif/loss/nce/logp -120.10/-11.87 /-108.23/ /-39.48 -7.51 /-0.74 17 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! [eos] tgt5: mod/noi/dif/loss/nce/logp -81.98 /-13.23 /-68.75 / /-0.00 -4.82 /-0.78 18 [bos] `` but he plays scar with chief crazy horse and his five colts '' ! ! [eos] cls0 - sp0 : -11.90 -2.38 6 0.20 [bos] : ! ! ! [eos] cls0 - sp1 : -12.55 -2.51 6 0.20 [bos] '' ! ! ! [eos] cls0 - sp2 : -13.43 -2.69 6 0.20 [bos] '' but ! ! [eos] cls0 - sp3 : -13.77 -2.75 6 0.20 [bos] : but ! ! [eos] cls0 - sp4 : -36.28 -2.13 18 0.00 [bos] '' but he its i with streets no couldn't and his i couldn't '' ! ! [eos] cls1 - sp0 : -10.10 -2.02 6 0.40 [bos] : ! ! ! [eos] cls1 - sp1 : -10.94 -2.19 6 0.40 [bos] '' ! ! ! [eos] cls1 - sp2 : -12.20 -2.44 6 0.40 [bos] : but ! ! [eos] cls1 - sp3 : -12.28 -2.46 6 0.40 [bos] '' but ! ! [eos] cls1 - sp4 : -12.37 -2.47 6 0.40 [bos] : ! ! ! [eos] cls2 - sp0 : -10.51 -2.10 6 0.60 [bos] : ! ! ! [eos] cls2 - sp1 : -10.83 -2.17 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.03 -2.21 6 0.60 [bos] '' ! ! ! [eos] cls2 - sp3 : -12.77 -2.55 6 0.60 [bos] : ! ! ! [eos] cls2 - sp4 : -28.25 -1.66 18 0.71 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] cls3 - sp0 : -11.08 -2.22 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -11.15 -2.23 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -26.67 -1.57 18 0.88 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] cls3 - sp3 : -26.79 -1.58 18 0.82 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] cls3 - sp4 : -27.42 -1.61 18 1.00 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-157 src: none none 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -80.84 /-1.64 /-79.20 /11.68/-11.68 -4.76 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -80.84 /-1.64 /-79.20 / /-11.68 -4.76 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -105.30/-13.48 /-91.82 / /-24.29 -6.19 /-0.79 18 [bos] `` but he plays bass with chief crazy horse and fifty five colts '' ! ! [eos] tgt3: mod/noi/dif/loss/nce/logp -186.99/-12.38 /-174.60/ /-107.08 -12.47/-0.83 16 [bos] `` but he plays bass with chief crazy horse and his five colts . [eos] tgt4: mod/noi/dif/loss/nce/logp -119.18/-11.87 /-107.31/ /-39.78 -7.45 /-0.74 17 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! [eos] tgt5: mod/noi/dif/loss/nce/logp -80.76 /-13.23 /-67.53 / /-0.00 -4.75 /-0.78 18 [bos] `` but he plays scar with chief crazy horse and his five colts '' ! ! [eos] cls0 - sp0 : -11.90 -2.38 6 0.20 [bos] : ! ! ! [eos] cls0 - sp1 : -12.55 -2.51 6 0.20 [bos] '' ! ! ! [eos] cls0 - sp2 : -13.43 -2.69 6 0.20 [bos] '' but ! ! [eos] cls0 - sp3 : -13.77 -2.75 6 0.20 [bos] : but ! ! [eos] cls0 - sp4 : -36.28 -2.13 18 0.00 [bos] '' but he its i with streets no couldn't and his i couldn't '' ! ! [eos] cls1 - sp0 : -10.10 -2.02 6 0.40 [bos] : ! ! ! [eos] cls1 - sp1 : -10.94 -2.19 6 0.40 [bos] '' ! ! ! [eos] cls1 - sp2 : -12.20 -2.44 6 0.40 [bos] : but ! ! [eos] cls1 - sp3 : -12.28 -2.46 6 0.40 [bos] '' but ! ! [eos] cls1 - sp4 : -12.37 -2.47 6 0.40 [bos] : ! ! ! [eos] cls2 - sp0 : -10.51 -2.10 6 0.60 [bos] : ! ! ! [eos] cls2 - sp1 : -10.83 -2.17 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.03 -2.21 6 0.60 [bos] '' ! ! ! [eos] cls2 - sp3 : -12.77 -2.55 6 0.60 [bos] : ! ! ! [eos] cls2 - sp4 : -28.25 -1.66 18 0.71 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] cls3 - sp0 : -11.08 -2.22 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -11.15 -2.23 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -26.67 -1.57 18 0.88 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] cls3 - sp3 : -26.79 -1.58 18 0.82 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] cls3 - sp4 : -27.42 -1.61 18 1.00 [bos] ! ! ! ! ! with ! ! ! and his ! ! '' ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-158 src: none none 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -81.17 /-1.64 /-79.54 /7.64/-7.64 -4.77 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -81.17 /-1.64 /-79.54 / /-7.64 -4.77 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -102.64/-13.48 /-89.15 / /-17.26 -6.04 /-0.79 18 [bos] `` but he plays bass with chief crazy horse and fifty five colts '' ! ! [eos] tgt3: mod/noi/dif/loss/nce/logp -184.89/-12.38 /-172.51/ /-100.61 -12.33/-0.83 16 [bos] `` but he plays bass with chief crazy horse and his five colts . [eos] tgt4: mod/noi/dif/loss/nce/logp -117.13/-11.87 /-105.25/ /-33.36 -7.32 /-0.74 17 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! [eos] tgt5: mod/noi/dif/loss/nce/logp -85.13 /-13.23 /-71.90 / /-0.00 -5.01 /-0.78 18 [bos] `` but he plays scar with chief crazy horse and his five colts '' ! ! [eos] cls0 - sp0 : -13.05 -2.61 6 0.20 [bos] ! ! i ! [eos] cls0 - sp1 : -13.35 -2.67 6 0.20 [bos] : ! ! ! [eos] cls0 - sp2 : -14.12 -2.82 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -39.44 -2.32 18 0.00 [bos] '' but i mean dr. with i streets ! and his i couldn't '' ! ! [eos] cls0 - sp4 : -39.46 -2.32 18 0.00 [bos] '' but i mean mean with i streets ! and his i couldn't '' ! ! [eos] cls1 - sp0 : -8.01 -2.00 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -8.19 -2.05 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -9.06 -2.26 5 0.25 [bos] : ! ! [eos] cls1 - sp3 : -9.08 -2.27 5 0.25 [bos] she ! ! [eos] cls1 - sp4 : -10.68 -2.67 5 0.25 [bos] '' ! ! [eos] cls2 - sp0 : -8.04 -2.01 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -8.28 -2.07 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -8.51 -2.13 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -8.79 -2.20 5 0.50 [bos] ! ! ! [eos] cls2 - sp4 : -9.18 -2.30 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -8.22 -2.06 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -8.35 -2.09 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -8.64 -2.16 5 1.00 [bos] ! ! ! [eos] cls3 - sp3 : -8.72 -2.18 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -9.53 -2.38 5 0.75 [bos] ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-159 src: none none 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -83.29 /-1.64 /-81.65 /11.31/-11.31 -4.90 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -83.29 /-1.64 /-81.65 / /-11.31 -4.90 /-0.10 18 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -106.34/-13.48 /-92.85 / /-22.50 -6.26 /-0.79 18 [bos] `` but he plays bass with chief crazy horse and fifty five colts '' ! ! [eos] tgt3: mod/noi/dif/loss/nce/logp -179.05/-12.38 /-166.67/ /-96.32 -11.94/-0.83 16 [bos] `` but he plays bass with chief crazy horse and his five colts . [eos] tgt4: mod/noi/dif/loss/nce/logp -117.62/-11.87 /-105.75/ /-35.40 -7.35 /-0.74 17 [bos] `` but he plays bass with chief crazy horse and his five colts '' ! [eos] tgt5: mod/noi/dif/loss/nce/logp -83.58 /-13.23 /-70.35 / /-0.00 -4.92 /-0.78 18 [bos] `` but he plays scar with chief crazy horse and his five colts '' ! ! [eos] cls0 - sp0 : -13.05 -2.61 6 0.20 [bos] ! ! i ! [eos] cls0 - sp1 : -13.35 -2.67 6 0.20 [bos] : ! ! ! [eos] cls0 - sp2 : -14.12 -2.82 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -39.44 -2.32 18 0.00 [bos] '' but i mean dr. with i streets ! and his i couldn't '' ! ! [eos] cls0 - sp4 : -39.46 -2.32 18 0.00 [bos] '' but i mean mean with i streets ! and his i couldn't '' ! ! [eos] cls1 - sp0 : -8.01 -2.00 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -8.19 -2.05 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -9.06 -2.26 5 0.25 [bos] : ! ! [eos] cls1 - sp3 : -9.08 -2.27 5 0.25 [bos] she ! ! [eos] cls1 - sp4 : -10.68 -2.67 5 0.25 [bos] '' ! ! [eos] cls2 - sp0 : -8.04 -2.01 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -8.28 -2.07 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -8.51 -2.13 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -8.79 -2.20 5 0.50 [bos] ! ! ! [eos] cls2 - sp4 : -9.18 -2.30 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -8.22 -2.06 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -8.35 -2.09 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -8.64 -2.16 5 1.00 [bos] ! ! ! [eos] cls3 - sp3 : -8.72 -2.18 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -9.53 -2.38 5 0.75 [bos] ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-160 src: none none 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt0: mod/noi/dif/loss/nce/logp -84.96 /-1.55 /-83.41 /0.69/-0.69 -5.66 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt1: mod/noi/dif/loss/nce/logp -84.96 /-1.55 /-83.41 / /-0.69 -5.66 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt2: mod/noi/dif/loss/nce/logp -120.41/-12.42 /-107.99/ /-25.27 -8.60 /-0.89 15 [bos] he swung around , eyes toward the bedroom , some fifteen feet away [eos] tgt3: mod/noi/dif/loss/nce/logp -121.94/-12.74 /-109.21/ /-26.49 -7.62 /-0.80 17 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . . [eos] tgt4: mod/noi/dif/loss/nce/logp -110.60/-13.01 /-97.59 / /-14.88 -7.37 /-0.87 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away , [eos] tgt5: mod/noi/dif/loss/nce/logp -106.55/-13.00 /-93.55 / /-10.84 -7.10 /-0.87 16 [bos] he swung around , eyes toward a bedroom , some fifteen feet away . [eos] cls0 - sp0 : -21.27 -1.77 13 0.17 [bos] ! ! ! , ) ! the first , some ! [eos] cls0 - sp1 : -21.51 -1.79 13 0.17 [bos] ! ! ! , ) ! the joined , some ! [eos] cls0 - sp2 : -21.53 -1.79 13 0.17 [bos] ! ! ! , ) ! the first , some no [eos] cls0 - sp3 : -21.61 -1.80 13 0.17 [bos] ! ! ! , ) ! the couldn't , some no [eos] cls0 - sp4 : -21.64 -1.80 13 0.17 [bos] ! ! ! , ) ! the couldn't , some ! [eos] cls1 - sp0 : -21.48 -1.79 13 0.25 [bos] ! ! ! , ) ! the first , some ! [eos] cls1 - sp1 : -21.52 -1.79 13 0.25 [bos] ! ! ! , ) ! the first , some ! [eos] cls1 - sp2 : -21.65 -1.80 13 0.33 [bos] ! ! ! , ) ! the first , some ! [eos] cls1 - sp3 : -21.79 -1.82 13 0.25 [bos] ! ! ! , ) ! the joined , some ! [eos] cls1 - sp4 : -21.84 -1.82 13 0.25 [bos] ! ! ! , ) ! the first , some no [eos] cls2 - sp0 : -22.84 -1.90 13 0.67 [bos] ! ! ! , ) ! the personal , some ! [eos] cls2 - sp1 : -22.99 -1.92 13 0.67 [bos] ! ! ! , ) ! the don't , some ! [eos] cls2 - sp2 : -22.99 -1.92 13 0.67 [bos] ! ! ! , ) ! the ! , some ! [eos] cls2 - sp3 : -23.26 -1.94 13 0.67 [bos] ! ! ! , ) ! the 7 , some ! [eos] cls2 - sp4 : -23.27 -1.94 13 0.67 [bos] ! ! ! , ) ! the corner , some ! [eos] cls3 - sp0 : -18.27 -1.52 13 1.00 [bos] ! ! ! , ) ! the corner , some ! [eos] cls3 - sp1 : -18.40 -1.53 13 1.00 [bos] ! ! ! , ) ! the personal , some ! [eos] cls3 - sp2 : -18.76 -1.56 13 1.00 [bos] ! ! ! , ) ! the don't , some ! [eos] cls3 - sp3 : -18.90 -1.58 13 1.00 [bos] ! ! ! , ) ! the later , some ! [eos] cls3 - sp4 : -18.97 -1.58 13 1.00 [bos] ! ! ! , ) ! the rome , some ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-161 src: none none 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt0: mod/noi/dif/loss/nce/logp -75.29 /-1.55 /-73.74 /0.69/-0.69 -5.02 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt1: mod/noi/dif/loss/nce/logp -75.29 /-1.55 /-73.74 / /-0.69 -5.02 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt2: mod/noi/dif/loss/nce/logp -116.89/-12.42 /-104.47/ /-31.42 -8.35 /-0.89 15 [bos] he swung around , eyes toward the bedroom , some fifteen feet away [eos] tgt3: mod/noi/dif/loss/nce/logp -112.01/-12.74 /-99.27 / /-26.23 -7.00 /-0.80 17 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . . [eos] tgt4: mod/noi/dif/loss/nce/logp -98.58 /-13.01 /-85.56 / /-12.52 -6.57 /-0.87 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away , [eos] tgt5: mod/noi/dif/loss/nce/logp -96.10 /-13.00 /-83.10 / /-10.06 -6.41 /-0.87 16 [bos] he swung around , eyes toward a bedroom , some fifteen feet away . [eos] cls0 - sp0 : -21.27 -1.77 13 0.17 [bos] ! ! ! , ) ! the first , some ! [eos] cls0 - sp1 : -21.51 -1.79 13 0.17 [bos] ! ! ! , ) ! the joined , some ! [eos] cls0 - sp2 : -21.53 -1.79 13 0.17 [bos] ! ! ! , ) ! the first , some no [eos] cls0 - sp3 : -21.61 -1.80 13 0.17 [bos] ! ! ! , ) ! the couldn't , some no [eos] cls0 - sp4 : -21.64 -1.80 13 0.17 [bos] ! ! ! , ) ! the couldn't , some ! [eos] cls1 - sp0 : -21.48 -1.79 13 0.25 [bos] ! ! ! , ) ! the first , some ! [eos] cls1 - sp1 : -21.52 -1.79 13 0.25 [bos] ! ! ! , ) ! the first , some ! [eos] cls1 - sp2 : -21.65 -1.80 13 0.33 [bos] ! ! ! , ) ! the first , some ! [eos] cls1 - sp3 : -21.79 -1.82 13 0.25 [bos] ! ! ! , ) ! the joined , some ! [eos] cls1 - sp4 : -21.84 -1.82 13 0.25 [bos] ! ! ! , ) ! the first , some no [eos] cls2 - sp0 : -22.84 -1.90 13 0.67 [bos] ! ! ! , ) ! the personal , some ! [eos] cls2 - sp1 : -22.99 -1.92 13 0.67 [bos] ! ! ! , ) ! the don't , some ! [eos] cls2 - sp2 : -22.99 -1.92 13 0.67 [bos] ! ! ! , ) ! the ! , some ! [eos] cls2 - sp3 : -23.26 -1.94 13 0.67 [bos] ! ! ! , ) ! the 7 , some ! [eos] cls2 - sp4 : -23.27 -1.94 13 0.67 [bos] ! ! ! , ) ! the corner , some ! [eos] cls3 - sp0 : -18.27 -1.52 13 1.00 [bos] ! ! ! , ) ! the corner , some ! [eos] cls3 - sp1 : -18.40 -1.53 13 1.00 [bos] ! ! ! , ) ! the personal , some ! [eos] cls3 - sp2 : -18.76 -1.56 13 1.00 [bos] ! ! ! , ) ! the don't , some ! [eos] cls3 - sp3 : -18.90 -1.58 13 1.00 [bos] ! ! ! , ) ! the later , some ! [eos] cls3 - sp4 : -18.97 -1.58 13 1.00 [bos] ! ! ! , ) ! the rome , some ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-162 src: none none 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt0: mod/noi/dif/loss/nce/logp -86.05 /-1.55 /-84.49 /0.69/-0.69 -5.74 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt1: mod/noi/dif/loss/nce/logp -86.05 /-1.55 /-84.49 / /-0.69 -5.74 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt2: mod/noi/dif/loss/nce/logp -120.85/-12.42 /-108.43/ /-24.64 -8.63 /-0.89 15 [bos] he swung around , eyes toward the bedroom , some fifteen feet away [eos] tgt3: mod/noi/dif/loss/nce/logp -120.30/-12.74 /-107.56/ /-23.76 -7.52 /-0.80 17 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . . [eos] tgt4: mod/noi/dif/loss/nce/logp -110.66/-13.01 /-97.65 / /-13.85 -7.38 /-0.87 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away , [eos] tgt5: mod/noi/dif/loss/nce/logp -108.08/-13.00 /-95.09 / /-11.29 -7.21 /-0.87 16 [bos] he swung around , eyes toward a bedroom , some fifteen feet away . [eos] cls0 - sp0 : -24.44 -2.04 13 0.00 [bos] she ) ! , ! ! the any , some ! [eos] cls0 - sp1 : -24.57 -2.05 13 0.00 [bos] she ) ! , ! ! the 7 , some ! [eos] cls0 - sp2 : -24.73 -2.06 13 0.00 [bos] she ) ! , ! ! the most , some ! [eos] cls0 - sp3 : -24.77 -2.06 13 0.00 [bos] she ) ! , ! ! the any , out ! [eos] cls0 - sp4 : -24.78 -2.07 13 0.00 [bos] she ) ! , ! ! the couldn't , some ! [eos] cls1 - sp0 : -26.19 -2.18 13 0.25 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls1 - sp1 : -26.32 -2.19 13 0.33 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls1 - sp2 : -26.41 -2.20 13 0.33 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls1 - sp3 : -26.44 -2.20 13 0.25 [bos] ! ! ! , ! ! the couldn't , out ! [eos] cls1 - sp4 : -26.47 -2.21 13 0.42 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls2 - sp0 : -25.43 -2.12 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp1 : -25.76 -2.15 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp2 : -25.93 -2.16 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp3 : -26.27 -2.19 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp4 : -26.34 -2.19 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls3 - sp0 : -22.50 -1.88 13 0.83 [bos] ! ! ! , ! ! the ! , some ! [eos] cls3 - sp1 : -23.29 -1.94 13 0.83 [bos] ! ! ! , ! ! the 7 , some ! [eos] cls3 - sp2 : -23.30 -1.94 13 0.83 [bos] ! ! ! , ! ! the no , some ! [eos] cls3 - sp3 : -23.41 -1.95 13 0.83 [bos] ! ! ! , ! ! the don't , some ! [eos] cls3 - sp4 : -23.49 -1.96 13 0.83 [bos] ! ! ! , ! ! the ! , some ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-163 src: none none 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt0: mod/noi/dif/loss/nce/logp -77.36 /-1.55 /-75.80 /0.69/-0.69 -5.16 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt1: mod/noi/dif/loss/nce/logp -77.36 /-1.55 /-75.80 / /-0.69 -5.16 /-0.10 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . [eos] tgt2: mod/noi/dif/loss/nce/logp -117.01/-12.42 /-104.59/ /-29.48 -8.36 /-0.89 15 [bos] he swung around , eyes toward the bedroom , some fifteen feet away [eos] tgt3: mod/noi/dif/loss/nce/logp -112.39/-12.74 /-99.65 / /-24.54 -7.02 /-0.80 17 [bos] he swung around , eyes toward the bedroom , some fifteen feet away . . [eos] tgt4: mod/noi/dif/loss/nce/logp -100.15/-13.01 /-87.14 / /-12.03 -6.68 /-0.87 16 [bos] he swung around , eyes toward the bedroom , some fifteen feet away , [eos] tgt5: mod/noi/dif/loss/nce/logp -98.57 /-13.00 /-85.58 / /-10.47 -6.57 /-0.87 16 [bos] he swung around , eyes toward a bedroom , some fifteen feet away . [eos] cls0 - sp0 : -24.44 -2.04 13 0.00 [bos] she ) ! , ! ! the any , some ! [eos] cls0 - sp1 : -24.57 -2.05 13 0.00 [bos] she ) ! , ! ! the 7 , some ! [eos] cls0 - sp2 : -24.73 -2.06 13 0.00 [bos] she ) ! , ! ! the most , some ! [eos] cls0 - sp3 : -24.77 -2.06 13 0.00 [bos] she ) ! , ! ! the any , out ! [eos] cls0 - sp4 : -24.78 -2.07 13 0.00 [bos] she ) ! , ! ! the couldn't , some ! [eos] cls1 - sp0 : -26.19 -2.18 13 0.25 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls1 - sp1 : -26.32 -2.19 13 0.33 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls1 - sp2 : -26.41 -2.20 13 0.33 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls1 - sp3 : -26.44 -2.20 13 0.25 [bos] ! ! ! , ! ! the couldn't , out ! [eos] cls1 - sp4 : -26.47 -2.21 13 0.42 [bos] ! ! ! , ! ! the couldn't , some ! [eos] cls2 - sp0 : -25.43 -2.12 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp1 : -25.76 -2.15 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp2 : -25.93 -2.16 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp3 : -26.27 -2.19 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls2 - sp4 : -26.34 -2.19 13 0.67 [bos] ! ! ! , ! ! the ! , some ! [eos] cls3 - sp0 : -22.50 -1.88 13 0.83 [bos] ! ! ! , ! ! the ! , some ! [eos] cls3 - sp1 : -23.29 -1.94 13 0.83 [bos] ! ! ! , ! ! the 7 , some ! [eos] cls3 - sp2 : -23.30 -1.94 13 0.83 [bos] ! ! ! , ! ! the no , some ! [eos] cls3 - sp3 : -23.41 -1.95 13 0.83 [bos] ! ! ! , ! ! the don't , some ! [eos] cls3 - sp4 : -23.49 -1.96 13 0.83 [bos] ! ! ! , ! ! the ! , some ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-164 src: none none 7 [bos] martin strained his ears . [eos] tgt0: mod/noi/dif/loss/nce/logp -38.55 /-0.54 /-38.01 /6.62/-6.62 -6.42 /-0.09 7 [bos] martin strained his ears . [eos] tgt1: mod/noi/dif/loss/nce/logp -38.55 /-0.54 /-38.01 / /-6.62 -6.42 /-0.09 7 [bos] martin strained his ears . [eos] tgt2: mod/noi/dif/loss/nce/logp -62.43 /-12.41 /-50.02 / /-18.63 -10.41/-2.07 7 [bos] martin strained fifty ears . [eos] tgt3: mod/noi/dif/loss/nce/logp -42.89 /-11.50 /-31.39 / /-0.00 -7.15 /-1.92 7 [bos] martin strained his colt . [eos] tgt4: mod/noi/dif/loss/nce/logp -68.20 /-11.54 /-56.67 / /-25.28 -13.64/-2.31 6 [bos] martin strained his ears [eos] tgt5: mod/noi/dif/loss/nce/logp -74.14 /-11.65 /-62.49 / /-31.11 -10.59/-1.66 8 [bos] martin strained his ears . . [eos] cls0 - sp0 : -12.31 -2.05 7 0.00 [bos] she ) his ! . [eos] cls0 - sp1 : -12.52 -2.09 7 0.00 [bos] she ) his later . [eos] cls0 - sp2 : -12.54 -2.09 7 0.00 [bos] she ) his ) . [eos] cls0 - sp3 : -12.73 -2.12 7 0.17 [bos] she ) his ! . [eos] cls0 - sp4 : -12.89 -2.15 7 0.00 [bos] i no his later . [eos] cls1 - sp0 : -12.85 -2.14 7 0.33 [bos] she ) his ! . [eos] cls1 - sp1 : -13.30 -2.22 7 0.33 [bos] we ) his ! . [eos] cls1 - sp2 : -14.09 -2.35 7 0.33 [bos] ! ) his ! . [eos] cls1 - sp3 : -14.22 -2.37 7 0.33 [bos] ! ! his ) . [eos] cls1 - sp4 : -14.28 -2.38 7 0.33 [bos] ! ! his ! ! [eos] cls2 - sp0 : -12.04 -2.01 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp1 : -12.13 -2.02 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp2 : -12.89 -2.15 7 0.50 [bos] ! ! his ! ! [eos] cls2 - sp3 : -13.50 -2.25 7 0.50 [bos] ! ! his ! ! [eos] cls2 - sp4 : -13.61 -2.27 7 0.50 [bos] ! ! his ! ! [eos] cls3 - sp0 : -11.18 -1.86 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp1 : -11.51 -1.92 7 0.83 [bos] no 7 his ! . [eos] cls3 - sp2 : -11.89 -1.98 7 0.83 [bos] we corner his ! . [eos] cls3 - sp3 : -12.63 -2.10 7 0.83 [bos] ! ) his ! ! [eos] cls3 - sp4 : -12.82 -2.14 7 0.83 [bos] ! ! his ) . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-165 src: none none 7 [bos] martin strained his ears . [eos] tgt0: mod/noi/dif/loss/nce/logp -44.73 /-0.54 /-44.19 /2.72/-2.72 -7.46 /-0.09 7 [bos] martin strained his ears . [eos] tgt1: mod/noi/dif/loss/nce/logp -44.73 /-0.54 /-44.19 / /-2.72 -7.46 /-0.09 7 [bos] martin strained his ears . [eos] tgt2: mod/noi/dif/loss/nce/logp -70.78 /-12.41 /-58.36 / /-16.89 -11.80/-2.07 7 [bos] martin strained fifty ears . [eos] tgt3: mod/noi/dif/loss/nce/logp -53.11 /-11.50 /-41.61 / /-0.14 -8.85 /-1.92 7 [bos] martin strained his colt . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.82 /-11.54 /-62.29 / /-20.82 -14.76/-2.31 6 [bos] martin strained his ears [eos] tgt5: mod/noi/dif/loss/nce/logp -81.91 /-11.65 /-70.26 / /-28.79 -11.70/-1.66 8 [bos] martin strained his ears . . [eos] cls0 - sp0 : -12.31 -2.05 7 0.00 [bos] she ) his ! . [eos] cls0 - sp1 : -12.52 -2.09 7 0.00 [bos] she ) his later . [eos] cls0 - sp2 : -12.54 -2.09 7 0.00 [bos] she ) his ) . [eos] cls0 - sp3 : -12.73 -2.12 7 0.17 [bos] she ) his ! . [eos] cls0 - sp4 : -12.89 -2.15 7 0.00 [bos] i no his later . [eos] cls1 - sp0 : -12.85 -2.14 7 0.33 [bos] she ) his ! . [eos] cls1 - sp1 : -13.30 -2.22 7 0.33 [bos] we ) his ! . [eos] cls1 - sp2 : -14.09 -2.35 7 0.33 [bos] ! ) his ! . [eos] cls1 - sp3 : -14.22 -2.37 7 0.33 [bos] ! ! his ) . [eos] cls1 - sp4 : -14.28 -2.38 7 0.33 [bos] ! ! his ! ! [eos] cls2 - sp0 : -12.04 -2.01 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp1 : -12.13 -2.02 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp2 : -12.89 -2.15 7 0.50 [bos] ! ! his ! ! [eos] cls2 - sp3 : -13.50 -2.25 7 0.50 [bos] ! ! his ! ! [eos] cls2 - sp4 : -13.61 -2.27 7 0.50 [bos] ! ! his ! ! [eos] cls3 - sp0 : -11.18 -1.86 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp1 : -11.51 -1.92 7 0.83 [bos] no 7 his ! . [eos] cls3 - sp2 : -11.89 -1.98 7 0.83 [bos] we corner his ! . [eos] cls3 - sp3 : -12.63 -2.10 7 0.83 [bos] ! ) his ! ! [eos] cls3 - sp4 : -12.82 -2.14 7 0.83 [bos] ! ! his ) . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-166 src: none none 7 [bos] martin strained his ears . [eos] tgt0: mod/noi/dif/loss/nce/logp -38.10 /-0.54 /-37.56 /6.21/-6.21 -6.35 /-0.09 7 [bos] martin strained his ears . [eos] tgt1: mod/noi/dif/loss/nce/logp -38.10 /-0.54 /-37.56 / /-6.21 -6.35 /-0.09 7 [bos] martin strained his ears . [eos] tgt2: mod/noi/dif/loss/nce/logp -60.15 /-12.41 /-47.74 / /-16.39 -10.02/-2.07 7 [bos] martin strained fifty ears . [eos] tgt3: mod/noi/dif/loss/nce/logp -42.86 /-11.50 /-31.36 / /-0.00 -7.14 /-1.92 7 [bos] martin strained his colt . [eos] tgt4: mod/noi/dif/loss/nce/logp -67.82 /-11.54 /-56.28 / /-24.93 -13.56/-2.31 6 [bos] martin strained his ears [eos] tgt5: mod/noi/dif/loss/nce/logp -71.64 /-11.65 /-59.99 / /-28.63 -10.23/-1.66 8 [bos] martin strained his ears . . [eos] cls0 - sp0 : -12.45 -2.07 7 0.00 [bos] it no his later . [eos] cls0 - sp1 : -12.46 -2.08 7 0.00 [bos] it no his ! . [eos] cls0 - sp2 : -12.59 -2.10 7 0.00 [bos] it couldn't his later . [eos] cls0 - sp3 : -12.59 -2.10 7 0.00 [bos] it couldn't his ! . [eos] cls0 - sp4 : -12.79 -2.13 7 0.00 [bos] it 7 his ! . [eos] cls1 - sp0 : -12.17 -2.03 7 0.33 [bos] ) 7 his ! . [eos] cls1 - sp1 : -12.46 -2.08 7 0.33 [bos] it 7 his ! . [eos] cls1 - sp2 : -12.59 -2.10 7 0.33 [bos] ) pain his ! . [eos] cls1 - sp3 : -12.87 -2.14 7 0.33 [bos] 7 7 his ! . [eos] cls1 - sp4 : -12.93 -2.15 7 0.33 [bos] it 7 his ! . [eos] cls2 - sp0 : -12.19 -2.03 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp1 : -12.25 -2.04 7 0.50 [bos] ! 7 his ! . [eos] cls2 - sp2 : -12.28 -2.05 7 0.67 [bos] ! 7 his ! . [eos] cls2 - sp3 : -12.76 -2.13 7 0.50 [bos] ! ! his ! . [eos] cls2 - sp4 : -13.20 -2.20 7 0.50 [bos] ! ! his ! ! [eos] cls3 - sp0 : -10.93 -1.82 7 0.83 [bos] no 7 his ! . [eos] cls3 - sp1 : -11.23 -1.87 7 0.83 [bos] ) 7 his ! . [eos] cls3 - sp2 : -11.29 -1.88 7 0.83 [bos] 7 7 his ! . [eos] cls3 - sp3 : -11.35 -1.89 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp4 : -11.50 -1.92 7 0.83 [bos] it 7 his ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-167 src: none none 7 [bos] martin strained his ears . [eos] tgt0: mod/noi/dif/loss/nce/logp -44.64 /-0.54 /-44.10 /2.84/-2.84 -7.44 /-0.09 7 [bos] martin strained his ears . [eos] tgt1: mod/noi/dif/loss/nce/logp -44.64 /-0.54 /-44.10 / /-2.84 -7.44 /-0.09 7 [bos] martin strained his ears . [eos] tgt2: mod/noi/dif/loss/nce/logp -68.53 /-12.41 /-56.12 / /-14.86 -11.42/-2.07 7 [bos] martin strained fifty ears . [eos] tgt3: mod/noi/dif/loss/nce/logp -52.88 /-11.50 /-41.38 / /-0.12 -8.81 /-1.92 7 [bos] martin strained his colt . [eos] tgt4: mod/noi/dif/loss/nce/logp -75.78 /-11.54 /-64.25 / /-22.99 -15.16/-2.31 6 [bos] martin strained his ears [eos] tgt5: mod/noi/dif/loss/nce/logp -80.16 /-11.65 /-68.51 / /-27.25 -11.45/-1.66 8 [bos] martin strained his ears . . [eos] cls0 - sp0 : -12.45 -2.07 7 0.00 [bos] it no his later . [eos] cls0 - sp1 : -12.46 -2.08 7 0.00 [bos] it no his ! . [eos] cls0 - sp2 : -12.59 -2.10 7 0.00 [bos] it couldn't his later . [eos] cls0 - sp3 : -12.59 -2.10 7 0.00 [bos] it couldn't his ! . [eos] cls0 - sp4 : -12.79 -2.13 7 0.00 [bos] it 7 his ! . [eos] cls1 - sp0 : -12.17 -2.03 7 0.33 [bos] ) 7 his ! . [eos] cls1 - sp1 : -12.46 -2.08 7 0.33 [bos] it 7 his ! . [eos] cls1 - sp2 : -12.59 -2.10 7 0.33 [bos] ) pain his ! . [eos] cls1 - sp3 : -12.87 -2.14 7 0.33 [bos] 7 7 his ! . [eos] cls1 - sp4 : -12.93 -2.15 7 0.33 [bos] it 7 his ! . [eos] cls2 - sp0 : -12.19 -2.03 7 0.67 [bos] ! ! his ! ! [eos] cls2 - sp1 : -12.25 -2.04 7 0.50 [bos] ! 7 his ! . [eos] cls2 - sp2 : -12.28 -2.05 7 0.67 [bos] ! 7 his ! . [eos] cls2 - sp3 : -12.76 -2.13 7 0.50 [bos] ! ! his ! . [eos] cls2 - sp4 : -13.20 -2.20 7 0.50 [bos] ! ! his ! ! [eos] cls3 - sp0 : -10.93 -1.82 7 0.83 [bos] no 7 his ! . [eos] cls3 - sp1 : -11.23 -1.87 7 0.83 [bos] ) 7 his ! . [eos] cls3 - sp2 : -11.29 -1.88 7 0.83 [bos] 7 7 his ! . [eos] cls3 - sp3 : -11.35 -1.89 7 0.83 [bos] ! ! his ! ! [eos] cls3 - sp4 : -11.50 -1.92 7 0.83 [bos] it 7 his ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-168 src: none none 8 [bos] the [unk] went home early . [eos] tgt0: mod/noi/dif/loss/nce/logp -40.97 /-0.82 /-40.15 /0.73/-0.73 -5.85 /-0.12 8 [bos] the [unk] went home early . [eos] tgt1: mod/noi/dif/loss/nce/logp -40.97 /-0.82 /-40.15 / /-0.73 -5.85 /-0.12 8 [bos] the [unk] went home early . [eos] tgt2: mod/noi/dif/loss/nce/logp -72.44 /-11.66 /-60.78 / /-21.36 -12.07/-1.94 7 [bos] the [unk] went home early [eos] tgt3: mod/noi/dif/loss/nce/logp -76.14 /-11.99 /-64.15 / /-24.74 -9.52 /-1.50 9 [bos] the [unk] went home early . . [eos] tgt4: mod/noi/dif/loss/nce/logp -54.75 /-11.99 /-42.75 / /-3.34 -7.82 /-1.71 8 [bos] the [unk] went allotment early . [eos] tgt5: mod/noi/dif/loss/nce/logp -57.48 /-12.26 /-45.22 / /-5.81 -8.21 /-1.75 8 [bos] a [unk] went home early . [eos] cls0 - sp0 : -8.97 -1.28 8 0.00 [bos] she [unk] she ! ! . [eos] cls0 - sp1 : -8.98 -1.28 8 0.00 [bos] she [unk] all ! ! . [eos] cls0 - sp2 : -9.24 -1.32 8 0.14 [bos] she [unk] all ! ! . [eos] cls0 - sp3 : -9.42 -1.35 8 0.14 [bos] she [unk] she ! ! . [eos] cls0 - sp4 : -9.55 -1.36 8 0.14 [bos] she [unk] first ! ! . [eos] cls1 - sp0 : -9.71 -1.39 8 0.43 [bos] she [unk] she ! ! . [eos] cls1 - sp1 : -9.81 -1.40 8 0.29 [bos] she [unk] she ! ! . [eos] cls1 - sp2 : -10.09 -1.44 8 0.29 [bos] she [unk] she ! ! . [eos] cls1 - sp3 : -10.09 -1.44 8 0.29 [bos] she [unk] she ! ! . [eos] cls1 - sp4 : -10.14 -1.45 8 0.29 [bos] she [unk] all ! ! . [eos] cls2 - sp0 : -9.26 -1.32 8 0.71 [bos] she [unk] all ! ! ! [eos] cls2 - sp1 : -10.37 -1.48 8 0.57 [bos] : [unk] she ! ! ! [eos] cls2 - sp2 : -10.38 -1.48 8 0.57 [bos] all [unk] she ! ! ! [eos] cls2 - sp3 : -10.61 -1.52 8 0.57 [bos] she [unk] she ! ! ! [eos] cls2 - sp4 : -10.97 -1.57 8 0.57 [bos] she [unk] she ! ! ! [eos] cls3 - sp0 : -7.64 -1.09 8 0.86 [bos] she [unk] all ! ! ! [eos] cls3 - sp1 : -8.28 -1.18 8 0.86 [bos] she [unk] don't ! ! ! [eos] cls3 - sp2 : -8.30 -1.19 8 0.86 [bos] she [unk] she ! ! ! [eos] cls3 - sp3 : -8.73 -1.25 8 0.86 [bos] she [unk] thought ! ! ! [eos] cls3 - sp4 : -8.73 -1.25 8 0.86 [bos] she [unk] made ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-169 src: none none 8 [bos] the [unk] went home early . [eos] tgt0: mod/noi/dif/loss/nce/logp -43.99 /-0.82 /-43.17 /0.7/-0.70 -6.28 /-0.12 8 [bos] the [unk] went home early . [eos] tgt1: mod/noi/dif/loss/nce/logp -43.99 /-0.82 /-43.17 / /-0.70 -6.28 /-0.12 8 [bos] the [unk] went home early . [eos] tgt2: mod/noi/dif/loss/nce/logp -78.41 /-11.66 /-66.75 / /-24.29 -13.07/-1.94 7 [bos] the [unk] went home early [eos] tgt3: mod/noi/dif/loss/nce/logp -80.74 /-11.99 /-68.75 / /-26.29 -10.09/-1.50 9 [bos] the [unk] went home early . . [eos] tgt4: mod/noi/dif/loss/nce/logp -60.94 /-11.99 /-48.94 / /-6.48 -8.71 /-1.71 8 [bos] the [unk] went allotment early . [eos] tgt5: mod/noi/dif/loss/nce/logp -59.47 /-12.26 /-47.21 / /-4.75 -8.50 /-1.75 8 [bos] a [unk] went home early . [eos] cls0 - sp0 : -8.97 -1.28 8 0.00 [bos] she [unk] she ! ! . [eos] cls0 - sp1 : -8.98 -1.28 8 0.00 [bos] she [unk] all ! ! . [eos] cls0 - sp2 : -9.24 -1.32 8 0.14 [bos] she [unk] all ! ! . [eos] cls0 - sp3 : -9.42 -1.35 8 0.14 [bos] she [unk] she ! ! . [eos] cls0 - sp4 : -9.55 -1.36 8 0.14 [bos] she [unk] first ! ! . [eos] cls1 - sp0 : -9.71 -1.39 8 0.43 [bos] she [unk] she ! ! . [eos] cls1 - sp1 : -9.81 -1.40 8 0.29 [bos] she [unk] she ! ! . [eos] cls1 - sp2 : -10.09 -1.44 8 0.29 [bos] she [unk] she ! ! . [eos] cls1 - sp3 : -10.09 -1.44 8 0.29 [bos] she [unk] she ! ! . [eos] cls1 - sp4 : -10.14 -1.45 8 0.29 [bos] she [unk] all ! ! . [eos] cls2 - sp0 : -9.26 -1.32 8 0.71 [bos] she [unk] all ! ! ! [eos] cls2 - sp1 : -10.37 -1.48 8 0.57 [bos] : [unk] she ! ! ! [eos] cls2 - sp2 : -10.38 -1.48 8 0.57 [bos] all [unk] she ! ! ! [eos] cls2 - sp3 : -10.61 -1.52 8 0.57 [bos] she [unk] she ! ! ! [eos] cls2 - sp4 : -10.97 -1.57 8 0.57 [bos] she [unk] she ! ! ! [eos] cls3 - sp0 : -7.64 -1.09 8 0.86 [bos] she [unk] all ! ! ! [eos] cls3 - sp1 : -8.28 -1.18 8 0.86 [bos] she [unk] don't ! ! ! [eos] cls3 - sp2 : -8.30 -1.19 8 0.86 [bos] she [unk] she ! ! ! [eos] cls3 - sp3 : -8.73 -1.25 8 0.86 [bos] she [unk] thought ! ! ! [eos] cls3 - sp4 : -8.73 -1.25 8 0.86 [bos] she [unk] made ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-170 src: none none 8 [bos] the [unk] went home early . [eos] tgt0: mod/noi/dif/loss/nce/logp -39.96 /-0.82 /-39.14 /0.74/-0.74 -5.71 /-0.12 8 [bos] the [unk] went home early . [eos] tgt1: mod/noi/dif/loss/nce/logp -39.96 /-0.82 /-39.14 / /-0.74 -5.71 /-0.12 8 [bos] the [unk] went home early . [eos] tgt2: mod/noi/dif/loss/nce/logp -69.91 /-11.66 /-58.25 / /-19.85 -11.65/-1.94 7 [bos] the [unk] went home early [eos] tgt3: mod/noi/dif/loss/nce/logp -73.87 /-11.99 /-61.88 / /-23.48 -9.23 /-1.50 9 [bos] the [unk] went home early . . [eos] tgt4: mod/noi/dif/loss/nce/logp -53.58 /-11.99 /-41.59 / /-3.19 -7.65 /-1.71 8 [bos] the [unk] went allotment early . [eos] tgt5: mod/noi/dif/loss/nce/logp -56.81 /-12.26 /-44.56 / /-6.16 -8.12 /-1.75 8 [bos] a [unk] went home early . [eos] cls0 - sp0 : -9.97 -1.42 8 0.00 [bos] she [unk] no ! ! . [eos] cls0 - sp1 : -10.20 -1.46 8 0.00 [bos] she [unk] couldn't ! ! . [eos] cls0 - sp2 : -10.34 -1.48 8 0.14 [bos] she [unk] ! ! ! . [eos] cls0 - sp3 : -10.46 -1.49 8 0.14 [bos] she [unk] no ! ! . [eos] cls0 - sp4 : -10.63 -1.52 8 0.14 [bos] she [unk] no ! ! . [eos] cls1 - sp0 : -10.00 -2.00 6 0.40 [bos] she [unk] ! ! [eos] cls1 - sp1 : -10.51 -1.50 8 0.29 [bos] she [unk] ! ! ! . [eos] cls1 - sp2 : -10.67 -2.13 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -10.69 -1.53 8 0.29 [bos] she [unk] ! ! ! . [eos] cls1 - sp4 : -10.88 -1.55 8 0.29 [bos] she [unk] first ! ! . [eos] cls2 - sp0 : -8.55 -1.22 8 0.71 [bos] she [unk] ! ! ! ! [eos] cls2 - sp1 : -9.61 -1.37 8 0.71 [bos] she [unk] no ! ! ! [eos] cls2 - sp2 : -9.62 -1.37 8 0.57 [bos] she [unk] ! ! ! ! [eos] cls2 - sp3 : -10.29 -1.47 8 0.57 [bos] ! ! ! ! ! ! [eos] cls2 - sp4 : -10.59 -1.51 8 0.57 [bos] she [unk] ! ! ! ! [eos] cls3 - sp0 : -7.62 -1.09 8 0.86 [bos] she [unk] ! ! ! ! [eos] cls3 - sp1 : -8.28 -1.18 8 0.86 [bos] she [unk] no ! ! ! [eos] cls3 - sp2 : -8.48 -1.21 8 0.86 [bos] she [unk] don't ! ! ! [eos] cls3 - sp3 : -8.58 -1.23 8 1.00 [bos] she [unk] ! ! ! ! [eos] cls3 - sp4 : -8.68 -1.24 8 0.86 [bos] she [unk] later ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-171 src: none none 8 [bos] the [unk] went home early . [eos] tgt0: mod/noi/dif/loss/nce/logp -43.38 /-0.82 /-42.56 /0.71/-0.71 -6.20 /-0.12 8 [bos] the [unk] went home early . [eos] tgt1: mod/noi/dif/loss/nce/logp -43.38 /-0.82 /-42.56 / /-0.71 -6.20 /-0.12 8 [bos] the [unk] went home early . [eos] tgt2: mod/noi/dif/loss/nce/logp -76.36 /-11.66 /-64.70 / /-22.86 -12.73/-1.94 7 [bos] the [unk] went home early [eos] tgt3: mod/noi/dif/loss/nce/logp -79.06 /-11.99 /-67.08 / /-25.23 -9.88 /-1.50 9 [bos] the [unk] went home early . . [eos] tgt4: mod/noi/dif/loss/nce/logp -59.91 /-11.99 /-47.92 / /-6.07 -8.56 /-1.71 8 [bos] the [unk] went allotment early . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.28 /-12.26 /-46.02 / /-4.17 -8.33 /-1.75 8 [bos] a [unk] went home early . [eos] cls0 - sp0 : -9.97 -1.42 8 0.00 [bos] she [unk] no ! ! . [eos] cls0 - sp1 : -10.20 -1.46 8 0.00 [bos] she [unk] couldn't ! ! . [eos] cls0 - sp2 : -10.34 -1.48 8 0.14 [bos] she [unk] ! ! ! . [eos] cls0 - sp3 : -10.46 -1.49 8 0.14 [bos] she [unk] no ! ! . [eos] cls0 - sp4 : -10.63 -1.52 8 0.14 [bos] she [unk] no ! ! . [eos] cls1 - sp0 : -10.00 -2.00 6 0.40 [bos] she [unk] ! ! [eos] cls1 - sp1 : -10.51 -1.50 8 0.29 [bos] she [unk] ! ! ! . [eos] cls1 - sp2 : -10.67 -2.13 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -10.69 -1.53 8 0.29 [bos] she [unk] ! ! ! . [eos] cls1 - sp4 : -10.88 -1.55 8 0.29 [bos] she [unk] first ! ! . [eos] cls2 - sp0 : -8.55 -1.22 8 0.71 [bos] she [unk] ! ! ! ! [eos] cls2 - sp1 : -9.61 -1.37 8 0.71 [bos] she [unk] no ! ! ! [eos] cls2 - sp2 : -9.62 -1.37 8 0.57 [bos] she [unk] ! ! ! ! [eos] cls2 - sp3 : -10.29 -1.47 8 0.57 [bos] ! ! ! ! ! ! [eos] cls2 - sp4 : -10.59 -1.51 8 0.57 [bos] she [unk] ! ! ! ! [eos] cls3 - sp0 : -7.62 -1.09 8 0.86 [bos] she [unk] ! ! ! ! [eos] cls3 - sp1 : -8.28 -1.18 8 0.86 [bos] she [unk] no ! ! ! [eos] cls3 - sp2 : -8.48 -1.21 8 0.86 [bos] she [unk] don't ! ! ! [eos] cls3 - sp3 : -8.58 -1.23 8 1.00 [bos] she [unk] ! ! ! ! [eos] cls3 - sp4 : -8.68 -1.24 8 0.86 [bos] she [unk] later ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-172 src: none none 7 [bos] quite a few laughed . [eos] tgt0: mod/noi/dif/loss/nce/logp -25.43 /-0.63 /-24.80 /0.88/-0.88 -4.24 /-0.11 7 [bos] quite a few laughed . [eos] tgt1: mod/noi/dif/loss/nce/logp -25.43 /-0.63 /-24.80 / /-0.88 -4.24 /-0.11 7 [bos] quite a few laughed . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.24 /-11.61 /-43.63 / /-19.72 -11.05/-2.32 6 [bos] quite a few laughed [eos] tgt3: mod/noi/dif/loss/nce/logp -46.38 /-11.70 /-34.68 / /-10.77 -7.73 /-1.95 7 [bos] quite the few laughed . [eos] tgt4: mod/noi/dif/loss/nce/logp -60.45 /-11.71 /-48.74 / /-24.83 -8.64 /-1.67 8 [bos] quite a few laughed . . [eos] tgt5: mod/noi/dif/loss/nce/logp -36.92 /-11.25 /-25.67 / /-1.76 -6.15 /-1.87 7 [bos] quite a few result . [eos] cls0 - sp0 : -7.86 -1.97 5 0.00 [bos] ! a ! [eos] cls0 - sp1 : -8.15 -2.04 5 0.00 [bos] she a ! [eos] cls0 - sp2 : -11.82 -2.36 6 0.20 [bos] ! a ! ! [eos] cls0 - sp3 : -12.05 -2.41 6 0.00 [bos] ! a ! ! [eos] cls0 - sp4 : -12.13 -2.02 7 0.00 [bos] she a this no . [eos] cls1 - sp0 : -7.07 -1.77 5 0.25 [bos] ! ) ! [eos] cls1 - sp1 : -7.98 -2.00 5 0.25 [bos] ! a ! [eos] cls1 - sp2 : -8.33 -2.08 5 0.25 [bos] ! a ! [eos] cls1 - sp3 : -11.52 -2.30 6 0.40 [bos] ! a ! ! [eos] cls1 - sp4 : -11.91 -2.38 6 0.40 [bos] ! a ! ! [eos] cls2 - sp0 : -7.08 -1.77 5 0.50 [bos] ! ) ! [eos] cls2 - sp1 : -7.47 -1.87 5 0.50 [bos] ! ) ! [eos] cls2 - sp2 : -7.61 -1.90 5 0.50 [bos] ! a ! [eos] cls2 - sp3 : -8.80 -2.20 5 0.50 [bos] don't a ! [eos] cls2 - sp4 : -8.81 -2.20 5 0.50 [bos] 7 a ! [eos] cls3 - sp0 : -6.97 -1.74 5 0.75 [bos] ! ) ! [eos] cls3 - sp1 : -9.35 -1.56 7 0.83 [bos] ! a ! ! ! [eos] cls3 - sp2 : -9.47 -2.37 5 1.00 [bos] ! ) ! [eos] cls3 - sp3 : -9.83 -2.46 5 0.75 [bos] ! ) ! [eos] cls3 - sp4 : -10.78 -1.80 7 0.83 [bos] ! ) ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-173 src: none none 7 [bos] quite a few laughed . [eos] tgt0: mod/noi/dif/loss/nce/logp -32.15 /-0.63 /-31.51 /0.73/-0.73 -5.36 /-0.11 7 [bos] quite a few laughed . [eos] tgt1: mod/noi/dif/loss/nce/logp -32.15 /-0.63 /-31.51 / /-0.73 -5.36 /-0.11 7 [bos] quite a few laughed . [eos] tgt2: mod/noi/dif/loss/nce/logp -60.04 /-11.61 /-48.43 / /-17.66 -12.01/-2.32 6 [bos] quite a few laughed [eos] tgt3: mod/noi/dif/loss/nce/logp -53.82 /-11.70 /-42.12 / /-11.35 -8.97 /-1.95 7 [bos] quite the few laughed . [eos] tgt4: mod/noi/dif/loss/nce/logp -69.25 /-11.71 /-57.55 / /-26.77 -9.89 /-1.67 8 [bos] quite a few laughed . . [eos] tgt5: mod/noi/dif/loss/nce/logp -45.22 /-11.25 /-33.98 / /-3.20 -7.54 /-1.87 7 [bos] quite a few result . [eos] cls0 - sp0 : -7.86 -1.97 5 0.00 [bos] ! a ! [eos] cls0 - sp1 : -8.15 -2.04 5 0.00 [bos] she a ! [eos] cls0 - sp2 : -11.82 -2.36 6 0.20 [bos] ! a ! ! [eos] cls0 - sp3 : -12.05 -2.41 6 0.00 [bos] ! a ! ! [eos] cls0 - sp4 : -12.13 -2.02 7 0.00 [bos] she a this no . [eos] cls1 - sp0 : -7.07 -1.77 5 0.25 [bos] ! ) ! [eos] cls1 - sp1 : -7.98 -2.00 5 0.25 [bos] ! a ! [eos] cls1 - sp2 : -8.33 -2.08 5 0.25 [bos] ! a ! [eos] cls1 - sp3 : -11.52 -2.30 6 0.40 [bos] ! a ! ! [eos] cls1 - sp4 : -11.91 -2.38 6 0.40 [bos] ! a ! ! [eos] cls2 - sp0 : -7.08 -1.77 5 0.50 [bos] ! ) ! [eos] cls2 - sp1 : -7.47 -1.87 5 0.50 [bos] ! ) ! [eos] cls2 - sp2 : -7.61 -1.90 5 0.50 [bos] ! a ! [eos] cls2 - sp3 : -8.80 -2.20 5 0.50 [bos] don't a ! [eos] cls2 - sp4 : -8.81 -2.20 5 0.50 [bos] 7 a ! [eos] cls3 - sp0 : -6.97 -1.74 5 0.75 [bos] ! ) ! [eos] cls3 - sp1 : -9.35 -1.56 7 0.83 [bos] ! a ! ! ! [eos] cls3 - sp2 : -9.47 -2.37 5 1.00 [bos] ! ) ! [eos] cls3 - sp3 : -9.83 -2.46 5 0.75 [bos] ! ) ! [eos] cls3 - sp4 : -10.78 -1.80 7 0.83 [bos] ! ) ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-174 src: none none 7 [bos] quite a few laughed . [eos] tgt0: mod/noi/dif/loss/nce/logp -25.55 /-0.63 /-24.91 /1.18/-1.18 -4.26 /-0.11 7 [bos] quite a few laughed . [eos] tgt1: mod/noi/dif/loss/nce/logp -25.55 /-0.63 /-24.91 / /-1.18 -4.26 /-0.11 7 [bos] quite a few laughed . [eos] tgt2: mod/noi/dif/loss/nce/logp -58.12 /-11.61 /-46.52 / /-22.78 -11.62/-2.32 6 [bos] quite a few laughed [eos] tgt3: mod/noi/dif/loss/nce/logp -46.97 /-11.70 /-35.27 / /-11.53 -7.83 /-1.95 7 [bos] quite the few laughed . [eos] tgt4: mod/noi/dif/loss/nce/logp -59.39 /-11.71 /-47.69 / /-23.95 -8.48 /-1.67 8 [bos] quite a few laughed . . [eos] tgt5: mod/noi/dif/loss/nce/logp -35.94 /-11.25 /-24.69 / /-0.96 -5.99 /-1.87 7 [bos] quite a few result . [eos] cls0 - sp0 : -10.62 -1.77 7 0.00 [bos] i a take ) . [eos] cls0 - sp1 : -10.73 -1.79 7 0.17 [bos] ! a take ) . [eos] cls0 - sp2 : -10.74 -1.79 7 0.00 [bos] i a no ) . [eos] cls0 - sp3 : -10.74 -1.79 7 0.00 [bos] she a take ) . [eos] cls0 - sp4 : -10.75 -1.79 7 0.00 [bos] ! a take ) . [eos] cls1 - sp0 : -11.47 -1.91 7 0.33 [bos] ! a take ) . [eos] cls1 - sp1 : -11.57 -1.93 7 0.33 [bos] ! a no ) . [eos] cls1 - sp2 : -11.71 -2.34 6 0.40 [bos] ! a ! ! [eos] cls1 - sp3 : -11.85 -1.98 7 0.33 [bos] ! a no no . [eos] cls1 - sp4 : -11.87 -1.98 7 0.33 [bos] ! a later ) . [eos] cls2 - sp0 : -10.11 -2.53 5 0.50 [bos] ! a ! [eos] cls2 - sp1 : -11.35 -1.89 7 0.67 [bos] ! a no ) . [eos] cls2 - sp2 : -13.02 -2.17 7 0.50 [bos] ! a ! ! ! [eos] cls2 - sp3 : -14.97 -2.49 7 0.50 [bos] ! a take 7 . [eos] cls2 - sp4 : -14.97 -2.50 7 0.50 [bos] ! a ! ! ! [eos] cls3 - sp0 : -10.19 -1.70 7 0.83 [bos] ! a don't ) . [eos] cls3 - sp1 : -10.25 -1.71 7 0.83 [bos] ! a 7 ) . [eos] cls3 - sp2 : -10.43 -1.74 7 0.83 [bos] ! a later ) . [eos] cls3 - sp3 : -10.51 -1.75 7 0.83 [bos] ! a no ) . [eos] cls3 - sp4 : -10.55 -1.76 7 0.83 [bos] ! a mean ) . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-175 src: none none 7 [bos] quite a few laughed . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.67 /-0.63 /-31.04 /0.8/-0.80 -5.28 /-0.11 7 [bos] quite a few laughed . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.67 /-0.63 /-31.04 / /-0.80 -5.28 /-0.11 7 [bos] quite a few laughed . [eos] tgt2: mod/noi/dif/loss/nce/logp -63.27 /-11.61 /-51.67 / /-21.43 -12.65/-2.32 6 [bos] quite a few laughed [eos] tgt3: mod/noi/dif/loss/nce/logp -53.58 /-11.70 /-41.88 / /-11.64 -8.93 /-1.95 7 [bos] quite the few laughed . [eos] tgt4: mod/noi/dif/loss/nce/logp -67.35 /-11.71 /-55.65 / /-25.41 -9.62 /-1.67 8 [bos] quite a few laughed . . [eos] tgt5: mod/noi/dif/loss/nce/logp -43.79 /-11.25 /-32.54 / /-2.31 -7.30 /-1.87 7 [bos] quite a few result . [eos] cls0 - sp0 : -10.62 -1.77 7 0.00 [bos] i a take ) . [eos] cls0 - sp1 : -10.73 -1.79 7 0.17 [bos] ! a take ) . [eos] cls0 - sp2 : -10.74 -1.79 7 0.00 [bos] i a no ) . [eos] cls0 - sp3 : -10.74 -1.79 7 0.00 [bos] she a take ) . [eos] cls0 - sp4 : -10.75 -1.79 7 0.00 [bos] ! a take ) . [eos] cls1 - sp0 : -11.47 -1.91 7 0.33 [bos] ! a take ) . [eos] cls1 - sp1 : -11.57 -1.93 7 0.33 [bos] ! a no ) . [eos] cls1 - sp2 : -11.71 -2.34 6 0.40 [bos] ! a ! ! [eos] cls1 - sp3 : -11.85 -1.98 7 0.33 [bos] ! a no no . [eos] cls1 - sp4 : -11.87 -1.98 7 0.33 [bos] ! a later ) . [eos] cls2 - sp0 : -10.11 -2.53 5 0.50 [bos] ! a ! [eos] cls2 - sp1 : -11.35 -1.89 7 0.67 [bos] ! a no ) . [eos] cls2 - sp2 : -13.02 -2.17 7 0.50 [bos] ! a ! ! ! [eos] cls2 - sp3 : -14.97 -2.49 7 0.50 [bos] ! a take 7 . [eos] cls2 - sp4 : -14.97 -2.50 7 0.50 [bos] ! a ! ! ! [eos] cls3 - sp0 : -10.19 -1.70 7 0.83 [bos] ! a don't ) . [eos] cls3 - sp1 : -10.25 -1.71 7 0.83 [bos] ! a 7 ) . [eos] cls3 - sp2 : -10.43 -1.74 7 0.83 [bos] ! a later ) . [eos] cls3 - sp3 : -10.51 -1.75 7 0.83 [bos] ! a no ) . [eos] cls3 - sp4 : -10.55 -1.76 7 0.83 [bos] ! a mean ) . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-176 src: none none 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt0: mod/noi/dif/loss/nce/logp -66.49 /-1.17 /-65.32 /7.34/-7.34 -6.04 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt1: mod/noi/dif/loss/nce/logp -66.49 /-1.17 /-65.32 / /-7.34 -6.04 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt2: mod/noi/dif/loss/nce/logp -101.84/-12.16 /-89.67 / /-31.70 -10.18/-1.22 11 [bos] they entered the bedroom , and dolores said nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -103.51/-12.37 /-91.13 / /-33.16 -8.63 /-1.03 13 [bos] they entered the bedroom , and dolores said nothing . . [eos] tgt4: mod/noi/dif/loss/nce/logp -71.60 /-13.62 /-57.98 / /-0.00 -6.51 /-1.24 12 [bos] they entered the unilateral , and dolores said nothing . [eos] tgt5: mod/noi/dif/loss/nce/logp -77.18 /-12.66 /-64.51 / /-6.54 -7.02 /-1.15 12 [bos] they entered the bedroom , and dolores said snatches . [eos] cls0 - sp0 : -18.24 -1.66 12 0.09 [bos] ! ! the later , and joined or ! . [eos] cls0 - sp1 : -18.33 -1.67 12 0.09 [bos] ! ! the later , and couldn't or ! . [eos] cls0 - sp2 : -18.39 -1.67 12 0.09 [bos] ! ! the couldn't , and joined or ! . [eos] cls0 - sp3 : -18.45 -1.68 12 0.09 [bos] ! ! the joined , and joined or ! . [eos] cls0 - sp4 : -18.48 -1.68 12 0.18 [bos] ! ! the later , and joined or ! . [eos] cls1 - sp0 : -19.27 -1.75 12 0.27 [bos] ! ! the later , and joined or ! . [eos] cls1 - sp1 : -19.31 -1.76 12 0.27 [bos] ! ! the later , and couldn't or ! . [eos] cls1 - sp2 : -19.36 -1.76 12 0.27 [bos] ! ! the couldn't , and joined or ! . [eos] cls1 - sp3 : -19.46 -1.77 12 0.27 [bos] ! ! the couldn't , and couldn't or ! . [eos] cls1 - sp4 : -19.52 -1.77 12 0.27 [bos] ! ! the joined , and joined or ! . [eos] cls2 - sp0 : -18.31 -1.66 12 0.64 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp1 : -18.87 -1.72 12 0.64 [bos] ! ! the personal , and ! or ! . [eos] cls2 - sp2 : -19.24 -1.75 12 0.55 [bos] ! ! the personal , and couldn't or ! . [eos] cls2 - sp3 : -19.25 -1.75 12 0.73 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp4 : -19.27 -1.75 12 0.64 [bos] ! ! the personal , and ! or ! . [eos] cls3 - sp0 : -14.86 -1.35 12 0.91 [bos] ! ! the personal , and ! ! ! . [eos] cls3 - sp1 : -14.95 -1.36 12 0.91 [bos] ! ! the later , and ! ! ! . [eos] cls3 - sp2 : -15.38 -1.40 12 0.91 [bos] ! ! the personal , and all life ! . [eos] cls3 - sp3 : -15.47 -1.41 12 0.91 [bos] ! ! the later , and all life ! . [eos] cls3 - sp4 : -15.57 -1.42 12 1.00 [bos] ! ! the personal , and ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-177 src: none none 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt0: mod/noi/dif/loss/nce/logp -63.05 /-1.17 /-61.88 /4.54/-4.54 -5.73 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt1: mod/noi/dif/loss/nce/logp -63.05 /-1.17 /-61.88 / /-4.54 -5.73 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt2: mod/noi/dif/loss/nce/logp -101.86/-12.16 /-89.70 / /-32.35 -10.19/-1.22 11 [bos] they entered the bedroom , and dolores said nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -101.64/-12.37 /-89.26 / /-31.92 -8.47 /-1.03 13 [bos] they entered the bedroom , and dolores said nothing . . [eos] tgt4: mod/noi/dif/loss/nce/logp -71.03 /-13.62 /-57.40 / /-0.06 -6.46 /-1.24 12 [bos] they entered the unilateral , and dolores said nothing . [eos] tgt5: mod/noi/dif/loss/nce/logp -73.28 /-12.66 /-60.62 / /-3.28 -6.66 /-1.15 12 [bos] they entered the bedroom , and dolores said snatches . [eos] cls0 - sp0 : -18.24 -1.66 12 0.09 [bos] ! ! the later , and joined or ! . [eos] cls0 - sp1 : -18.33 -1.67 12 0.09 [bos] ! ! the later , and couldn't or ! . [eos] cls0 - sp2 : -18.39 -1.67 12 0.09 [bos] ! ! the couldn't , and joined or ! . [eos] cls0 - sp3 : -18.45 -1.68 12 0.09 [bos] ! ! the joined , and joined or ! . [eos] cls0 - sp4 : -18.48 -1.68 12 0.18 [bos] ! ! the later , and joined or ! . [eos] cls1 - sp0 : -19.27 -1.75 12 0.27 [bos] ! ! the later , and joined or ! . [eos] cls1 - sp1 : -19.31 -1.76 12 0.27 [bos] ! ! the later , and couldn't or ! . [eos] cls1 - sp2 : -19.36 -1.76 12 0.27 [bos] ! ! the couldn't , and joined or ! . [eos] cls1 - sp3 : -19.46 -1.77 12 0.27 [bos] ! ! the couldn't , and couldn't or ! . [eos] cls1 - sp4 : -19.52 -1.77 12 0.27 [bos] ! ! the joined , and joined or ! . [eos] cls2 - sp0 : -18.31 -1.66 12 0.64 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp1 : -18.87 -1.72 12 0.64 [bos] ! ! the personal , and ! or ! . [eos] cls2 - sp2 : -19.24 -1.75 12 0.55 [bos] ! ! the personal , and couldn't or ! . [eos] cls2 - sp3 : -19.25 -1.75 12 0.73 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp4 : -19.27 -1.75 12 0.64 [bos] ! ! the personal , and ! or ! . [eos] cls3 - sp0 : -14.86 -1.35 12 0.91 [bos] ! ! the personal , and ! ! ! . [eos] cls3 - sp1 : -14.95 -1.36 12 0.91 [bos] ! ! the later , and ! ! ! . [eos] cls3 - sp2 : -15.38 -1.40 12 0.91 [bos] ! ! the personal , and all life ! . [eos] cls3 - sp3 : -15.47 -1.41 12 0.91 [bos] ! ! the later , and all life ! . [eos] cls3 - sp4 : -15.57 -1.42 12 1.00 [bos] ! ! the personal , and ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-178 src: none none 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt0: mod/noi/dif/loss/nce/logp -69.64 /-1.17 /-68.47 /8.17/-8.17 -6.33 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt1: mod/noi/dif/loss/nce/logp -69.64 /-1.17 /-68.47 / /-8.17 -6.33 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt2: mod/noi/dif/loss/nce/logp -102.98/-12.16 /-90.82 / /-30.52 -10.30/-1.22 11 [bos] they entered the bedroom , and dolores said nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -105.74/-12.37 /-93.37 / /-33.07 -8.81 /-1.03 13 [bos] they entered the bedroom , and dolores said nothing . . [eos] tgt4: mod/noi/dif/loss/nce/logp -73.92 /-13.62 /-60.30 / /-0.00 -6.72 /-1.24 12 [bos] they entered the unilateral , and dolores said nothing . [eos] tgt5: mod/noi/dif/loss/nce/logp -80.67 /-12.66 /-68.00 / /-7.70 -7.33 /-1.15 12 [bos] they entered the bedroom , and dolores said snatches . [eos] cls0 - sp0 : -21.09 -1.92 12 0.09 [bos] ! couldn't the 7 , and joined or ! . [eos] cls0 - sp1 : -21.17 -1.92 12 0.09 [bos] ! couldn't the couldn't , and joined or ! . [eos] cls0 - sp2 : -21.24 -1.93 12 0.09 [bos] ! couldn't the 7 , and couldn't or ! . [eos] cls0 - sp3 : -21.29 -1.94 12 0.18 [bos] ! couldn't the 7 , and joined or ! . [eos] cls0 - sp4 : -21.31 -1.94 12 0.09 [bos] ! couldn't the no , and joined or ! . [eos] cls1 - sp0 : -21.94 -1.99 12 0.27 [bos] ! couldn't the 7 , and joined or ! . [eos] cls1 - sp1 : -22.01 -2.00 12 0.27 [bos] ! couldn't the ! , and joined or ! . [eos] cls1 - sp2 : -22.06 -2.01 12 0.27 [bos] ! couldn't the 7 , and couldn't or ! . [eos] cls1 - sp3 : -22.18 -2.02 12 0.27 [bos] ! couldn't the ! , and couldn't or ! . [eos] cls1 - sp4 : -22.22 -2.02 12 0.27 [bos] ! couldn't the 7 , and streets or ! . [eos] cls2 - sp0 : -21.61 -1.96 12 0.64 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp1 : -21.96 -2.00 12 0.64 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp2 : -22.36 -2.03 12 0.64 [bos] ! ! the ! , and ! or ! . [eos] cls2 - sp3 : -22.37 -2.03 12 0.55 [bos] ! ! the ! , and corner or ! . [eos] cls2 - sp4 : -22.42 -2.04 12 0.64 [bos] ! ! the ! , and ! life ! . [eos] cls3 - sp0 : -18.26 -1.66 12 0.91 [bos] ! ! the ! , and ! ! ! . [eos] cls3 - sp1 : -19.03 -1.73 12 0.91 [bos] ! she the ! , and telephone life ! . [eos] cls3 - sp2 : -19.06 -1.73 12 0.91 [bos] ! ! the ! , and telephone life ! . [eos] cls3 - sp3 : -19.11 -1.74 12 1.00 [bos] ! ! the ! , and ! ! ! . [eos] cls3 - sp4 : -19.24 -1.75 12 0.91 [bos] ! don't the ! , and telephone life ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-179 src: none none 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt0: mod/noi/dif/loss/nce/logp -64.80 /-1.17 /-63.63 /4.95/-4.95 -5.89 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt1: mod/noi/dif/loss/nce/logp -64.80 /-1.17 /-63.63 / /-4.95 -5.89 /-0.11 12 [bos] they entered the bedroom , and dolores said nothing . [eos] tgt2: mod/noi/dif/loss/nce/logp -100.82/-12.16 /-88.66 / /-29.98 -10.08/-1.22 11 [bos] they entered the bedroom , and dolores said nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -102.94/-12.37 /-90.57 / /-31.90 -8.58 /-1.03 13 [bos] they entered the bedroom , and dolores said nothing . . [eos] tgt4: mod/noi/dif/loss/nce/logp -72.33 /-13.62 /-58.71 / /-0.04 -6.58 /-1.24 12 [bos] they entered the unilateral , and dolores said nothing . [eos] tgt5: mod/noi/dif/loss/nce/logp -75.19 /-12.66 /-62.52 / /-3.85 -6.84 /-1.15 12 [bos] they entered the bedroom , and dolores said snatches . [eos] cls0 - sp0 : -21.09 -1.92 12 0.09 [bos] ! couldn't the 7 , and joined or ! . [eos] cls0 - sp1 : -21.17 -1.92 12 0.09 [bos] ! couldn't the couldn't , and joined or ! . [eos] cls0 - sp2 : -21.24 -1.93 12 0.09 [bos] ! couldn't the 7 , and couldn't or ! . [eos] cls0 - sp3 : -21.29 -1.94 12 0.18 [bos] ! couldn't the 7 , and joined or ! . [eos] cls0 - sp4 : -21.31 -1.94 12 0.09 [bos] ! couldn't the no , and joined or ! . [eos] cls1 - sp0 : -21.94 -1.99 12 0.27 [bos] ! couldn't the 7 , and joined or ! . [eos] cls1 - sp1 : -22.01 -2.00 12 0.27 [bos] ! couldn't the ! , and joined or ! . [eos] cls1 - sp2 : -22.06 -2.01 12 0.27 [bos] ! couldn't the 7 , and couldn't or ! . [eos] cls1 - sp3 : -22.18 -2.02 12 0.27 [bos] ! couldn't the ! , and couldn't or ! . [eos] cls1 - sp4 : -22.22 -2.02 12 0.27 [bos] ! couldn't the 7 , and streets or ! . [eos] cls2 - sp0 : -21.61 -1.96 12 0.64 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp1 : -21.96 -2.00 12 0.64 [bos] ! ! the ! , and ! ! ! . [eos] cls2 - sp2 : -22.36 -2.03 12 0.64 [bos] ! ! the ! , and ! or ! . [eos] cls2 - sp3 : -22.37 -2.03 12 0.55 [bos] ! ! the ! , and corner or ! . [eos] cls2 - sp4 : -22.42 -2.04 12 0.64 [bos] ! ! the ! , and ! life ! . [eos] cls3 - sp0 : -18.26 -1.66 12 0.91 [bos] ! ! the ! , and ! ! ! . [eos] cls3 - sp1 : -19.03 -1.73 12 0.91 [bos] ! she the ! , and telephone life ! . [eos] cls3 - sp2 : -19.06 -1.73 12 0.91 [bos] ! ! the ! , and telephone life ! . [eos] cls3 - sp3 : -19.11 -1.74 12 1.00 [bos] ! ! the ! , and ! ! ! . [eos] cls3 - sp4 : -19.24 -1.75 12 0.91 [bos] ! don't the ! , and telephone life ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-180 src: none none 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt0: mod/noi/dif/loss/nce/logp -106.82/-2.01 /-104.81/0.7/-0.70 -5.34 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt1: mod/noi/dif/loss/nce/logp -106.82/-2.01 /-104.81/ /-0.70 -5.34 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt2: mod/noi/dif/loss/nce/logp -204.02/-11.98 /-192.04/ /-87.93 -14.57/-0.86 15 [bos] with her eyes dolores dared him for the truth , ready to begin [eos] tgt3: mod/noi/dif/loss/nce/logp -131.21/-12.90 /-118.31/ /-14.20 -6.56 /-0.65 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's the little contest -- [eos] tgt4: mod/noi/dif/loss/nce/logp -250.06/-12.11 /-237.95/ /-133.84 -35.72/-1.73 8 [bos] with her eyes dolores dared him [eos] tgt5: mod/noi/dif/loss/nce/logp -122.25/-12.85 /-109.40/ /-5.29 -6.11 /-0.64 21 [bos] with her eyes dolores dared him , the truth , ready to begin : it's a little contest -- [eos] cls0 - sp0 : -39.58 -2.20 19 0.06 [bos] we it any later cleaning him for the streets , streets to all '' first a ! [eos] cls0 - sp1 : -39.66 -2.20 19 0.06 [bos] we it any later cleaning him for the streets , joined to all '' first a ! [eos] cls0 - sp2 : -39.70 -2.21 19 0.06 [bos] we it any later cleaning him for the streets , joined to first '' first a ! [eos] cls0 - sp3 : -39.73 -2.21 19 0.06 [bos] we it any later cleaning him for the mean , streets to all '' first a ! [eos] cls0 - sp4 : -39.79 -2.21 19 0.06 [bos] we it any later cleaning him for the mean , joined to all '' first a ! [eos] cls1 - sp0 : -17.79 -3.56 6 0.40 [bos] we ! ! ! [eos] cls1 - sp1 : -35.08 -1.95 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all '' she a ! [eos] cls1 - sp2 : -35.11 -1.95 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp3 : -35.15 -1.95 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all : she a ! [eos] cls1 - sp4 : -35.19 -1.95 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp0 : -34.46 -1.91 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls2 - sp1 : -34.46 -1.91 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls2 - sp2 : -35.21 -1.96 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls2 - sp3 : -35.29 -1.96 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls2 - sp4 : -35.39 -1.97 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to first : ! a ! [eos] cls3 - sp0 : -29.64 -1.65 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls3 - sp1 : -29.65 -1.65 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls3 - sp2 : -29.67 -1.65 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to first : ! a ! [eos] cls3 - sp3 : -29.84 -1.66 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to corner : ! a ! [eos] cls3 - sp4 : -29.90 -1.66 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to inquirer : ! a ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-181 src: none none 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt0: mod/noi/dif/loss/nce/logp -99.91 /-2.01 /-97.90 /0.7/-0.70 -5.00 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt1: mod/noi/dif/loss/nce/logp -99.91 /-2.01 /-97.90 / /-0.70 -5.00 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt2: mod/noi/dif/loss/nce/logp -185.64/-11.98 /-173.66/ /-76.46 -13.26/-0.86 15 [bos] with her eyes dolores dared him for the truth , ready to begin [eos] tgt3: mod/noi/dif/loss/nce/logp -124.45/-12.90 /-111.55/ /-14.35 -6.22 /-0.65 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's the little contest -- [eos] tgt4: mod/noi/dif/loss/nce/logp -248.74/-12.11 /-236.63/ /-139.42 -35.53/-1.73 8 [bos] with her eyes dolores dared him [eos] tgt5: mod/noi/dif/loss/nce/logp -115.18/-12.85 /-102.33/ /-5.13 -5.76 /-0.64 21 [bos] with her eyes dolores dared him , the truth , ready to begin : it's a little contest -- [eos] cls0 - sp0 : -39.58 -2.20 19 0.06 [bos] we it any later cleaning him for the streets , streets to all '' first a ! [eos] cls0 - sp1 : -39.66 -2.20 19 0.06 [bos] we it any later cleaning him for the streets , joined to all '' first a ! [eos] cls0 - sp2 : -39.70 -2.21 19 0.06 [bos] we it any later cleaning him for the streets , joined to first '' first a ! [eos] cls0 - sp3 : -39.73 -2.21 19 0.06 [bos] we it any later cleaning him for the mean , streets to all '' first a ! [eos] cls0 - sp4 : -39.79 -2.21 19 0.06 [bos] we it any later cleaning him for the mean , joined to all '' first a ! [eos] cls1 - sp0 : -17.79 -3.56 6 0.40 [bos] we ! ! ! [eos] cls1 - sp1 : -35.08 -1.95 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all '' she a ! [eos] cls1 - sp2 : -35.11 -1.95 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp3 : -35.15 -1.95 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all : she a ! [eos] cls1 - sp4 : -35.19 -1.95 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp0 : -34.46 -1.91 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls2 - sp1 : -34.46 -1.91 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls2 - sp2 : -35.21 -1.96 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls2 - sp3 : -35.29 -1.96 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls2 - sp4 : -35.39 -1.97 19 0.72 [bos] ! ! ! ! ! ! is the ! , ! to first : ! a ! [eos] cls3 - sp0 : -29.64 -1.65 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls3 - sp1 : -29.65 -1.65 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to telephone : ! a ! [eos] cls3 - sp2 : -29.67 -1.65 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to first : ! a ! [eos] cls3 - sp3 : -29.84 -1.66 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to corner : ! a ! [eos] cls3 - sp4 : -29.90 -1.66 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to inquirer : ! a ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-182 src: none none 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt0: mod/noi/dif/loss/nce/logp -107.70/-2.01 /-105.69/0.71/-0.71 -5.39 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt1: mod/noi/dif/loss/nce/logp -107.70/-2.01 /-105.69/ /-0.71 -5.39 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt2: mod/noi/dif/loss/nce/logp -212.42/-11.98 /-200.44/ /-95.46 -15.17/-0.86 15 [bos] with her eyes dolores dared him for the truth , ready to begin [eos] tgt3: mod/noi/dif/loss/nce/logp -132.10/-12.90 /-119.20/ /-14.21 -6.60 /-0.65 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's the little contest -- [eos] tgt4: mod/noi/dif/loss/nce/logp -243.21/-12.11 /-231.10/ /-126.11 -34.74/-1.73 8 [bos] with her eyes dolores dared him [eos] tgt5: mod/noi/dif/loss/nce/logp -122.06/-12.85 /-109.21/ /-4.23 -6.10 /-0.64 21 [bos] with her eyes dolores dared him , the truth , ready to begin : it's a little contest -- [eos] cls0 - sp0 : -32.53 -1.81 19 0.17 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls0 - sp1 : -32.60 -1.81 19 0.17 [bos] ! it ! ! ! ! for the editor , be to all : ! a ! [eos] cls0 - sp2 : -32.79 -1.82 19 0.11 [bos] ! it ! ! ! ! for the editor , be to all : ! a ! [eos] cls0 - sp3 : -32.86 -1.83 19 0.22 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls0 - sp4 : -32.90 -1.83 19 0.17 [bos] ! it ! ! ! ! for the couldn't , be to all : ! a ! [eos] cls1 - sp0 : -29.23 -1.62 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp1 : -29.43 -1.64 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp2 : -29.67 -1.65 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp3 : -29.80 -1.66 19 0.39 [bos] ! ! ! ! ! ! for the editor , be to all : ! a ! [eos] cls1 - sp4 : -29.85 -1.66 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp0 : -29.41 -1.63 19 0.50 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp1 : -29.58 -1.64 19 0.50 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp2 : -29.63 -1.65 19 0.50 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp3 : -29.75 -1.65 19 0.56 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp4 : -29.77 -1.65 19 0.56 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls3 - sp0 : -26.31 -1.46 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls3 - sp1 : -26.51 -1.47 19 1.00 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls3 - sp2 : -26.67 -1.48 19 0.94 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls3 - sp3 : -26.97 -1.50 19 1.00 [bos] ! ! ! ! ! ! for the ! , made to all : ! a ! [eos] cls3 - sp4 : -27.02 -1.50 19 1.00 [bos] ! ! ! ! ! ! is the ! , made to all : ! a ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-183 src: none none 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt0: mod/noi/dif/loss/nce/logp -101.04/-2.01 /-99.03 /0.72/-0.72 -5.05 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt1: mod/noi/dif/loss/nce/logp -101.04/-2.01 /-99.03 / /-0.72 -5.05 /-0.10 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's a little contest -- [eos] tgt2: mod/noi/dif/loss/nce/logp -198.26/-11.98 /-186.28/ /-87.97 -14.16/-0.86 15 [bos] with her eyes dolores dared him for the truth , ready to begin [eos] tgt3: mod/noi/dif/loss/nce/logp -125.71/-12.90 /-112.81/ /-14.50 -6.29 /-0.65 21 [bos] with her eyes dolores dared him for the truth , ready to begin : it's the little contest -- [eos] tgt4: mod/noi/dif/loss/nce/logp -238.94/-12.11 /-226.83/ /-128.52 -34.13/-1.73 8 [bos] with her eyes dolores dared him [eos] tgt5: mod/noi/dif/loss/nce/logp -114.89/-12.85 /-102.05/ /-3.73 -5.74 /-0.64 21 [bos] with her eyes dolores dared him , the truth , ready to begin : it's a little contest -- [eos] cls0 - sp0 : -32.53 -1.81 19 0.17 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls0 - sp1 : -32.60 -1.81 19 0.17 [bos] ! it ! ! ! ! for the editor , be to all : ! a ! [eos] cls0 - sp2 : -32.79 -1.82 19 0.11 [bos] ! it ! ! ! ! for the editor , be to all : ! a ! [eos] cls0 - sp3 : -32.86 -1.83 19 0.22 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls0 - sp4 : -32.90 -1.83 19 0.17 [bos] ! it ! ! ! ! for the couldn't , be to all : ! a ! [eos] cls1 - sp0 : -29.23 -1.62 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp1 : -29.43 -1.64 19 0.39 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp2 : -29.67 -1.65 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls1 - sp3 : -29.80 -1.66 19 0.39 [bos] ! ! ! ! ! ! for the editor , be to all : ! a ! [eos] cls1 - sp4 : -29.85 -1.66 19 0.44 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp0 : -29.41 -1.63 19 0.50 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp1 : -29.58 -1.64 19 0.50 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp2 : -29.63 -1.65 19 0.50 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp3 : -29.75 -1.65 19 0.56 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls2 - sp4 : -29.77 -1.65 19 0.56 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls3 - sp0 : -26.31 -1.46 19 1.00 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls3 - sp1 : -26.51 -1.47 19 1.00 [bos] ! ! ! ! ! ! for the ! , ! to all : ! a ! [eos] cls3 - sp2 : -26.67 -1.48 19 0.94 [bos] ! ! ! ! ! ! is the ! , ! to all : ! a ! [eos] cls3 - sp3 : -26.97 -1.50 19 1.00 [bos] ! ! ! ! ! ! for the ! , made to all : ! a ! [eos] cls3 - sp4 : -27.02 -1.50 19 1.00 [bos] ! ! ! ! ! ! is the ! , made to all : ! a ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-184 src: none none 7 [bos] the most bizarre situation . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.69 /-0.63 /-34.06 /1.23/-1.23 -5.78 /-0.11 7 [bos] the most bizarre situation . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.69 /-0.63 /-34.06 / /-1.23 -5.78 /-0.11 7 [bos] the most bizarre situation . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.92 /-12.02 /-43.90 / /-11.07 -9.32 /-2.00 7 [bos] the external bizarre situation . [eos] tgt3: mod/noi/dif/loss/nce/logp -60.49 /-11.57 /-48.92 / /-16.10 -12.10/-2.31 6 [bos] the most bizarre situation [eos] tgt4: mod/noi/dif/loss/nce/logp -68.74 /-11.76 /-56.98 / /-24.15 -9.82 /-1.68 8 [bos] the most bizarre situation . . [eos] tgt5: mod/noi/dif/loss/nce/logp -45.22 /-11.51 /-33.70 / /-0.88 -7.54 /-1.92 7 [bos] the most bizarre factory . [eos] cls0 - sp0 : -9.14 -1.83 6 0.00 [bos] : ! ! ! [eos] cls0 - sp1 : -9.24 -1.54 7 0.17 [bos] she ! ! ! . [eos] cls0 - sp2 : -9.31 -1.86 6 0.20 [bos] : ! ! ! [eos] cls0 - sp3 : -9.44 -1.89 6 0.20 [bos] she ! ! ! [eos] cls0 - sp4 : -9.54 -1.59 7 0.17 [bos] : ! ! ! . [eos] cls1 - sp0 : -9.22 -1.54 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp1 : -9.33 -1.56 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp2 : -9.37 -1.56 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp3 : -9.47 -1.58 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp4 : -9.62 -1.92 6 0.40 [bos] : ! ! ! [eos] cls2 - sp0 : -7.65 -1.28 7 0.67 [bos] she ! ! ! . [eos] cls2 - sp1 : -7.85 -1.31 7 0.67 [bos] she ! ! ! ! [eos] cls2 - sp2 : -7.97 -1.33 7 0.67 [bos] she ! ! ! ! [eos] cls2 - sp3 : -8.26 -1.38 7 0.50 [bos] she ! ! ! . [eos] cls2 - sp4 : -8.49 -1.42 7 0.67 [bos] she ! ! ! ! [eos] cls3 - sp0 : -6.36 -1.06 7 0.83 [bos] she ! ! ! ! [eos] cls3 - sp1 : -7.06 -1.18 7 0.83 [bos] she ! ! ! . [eos] cls3 - sp2 : -7.56 -1.26 7 1.00 [bos] she ! ! ! ! [eos] cls3 - sp3 : -8.26 -1.38 7 0.83 [bos] she ! ! later . [eos] cls3 - sp4 : -8.35 -1.39 7 1.00 [bos] she ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-185 src: none none 7 [bos] the most bizarre situation . [eos] tgt0: mod/noi/dif/loss/nce/logp -46.95 /-0.63 /-46.32 /0.78/-0.78 -7.83 /-0.11 7 [bos] the most bizarre situation . [eos] tgt1: mod/noi/dif/loss/nce/logp -46.95 /-0.63 /-46.32 / /-0.78 -7.83 /-0.11 7 [bos] the most bizarre situation . [eos] tgt2: mod/noi/dif/loss/nce/logp -70.56 /-12.02 /-58.54 / /-13.00 -11.76/-2.00 7 [bos] the external bizarre situation . [eos] tgt3: mod/noi/dif/loss/nce/logp -76.37 /-11.57 /-64.80 / /-19.27 -15.27/-2.31 6 [bos] the most bizarre situation [eos] tgt4: mod/noi/dif/loss/nce/logp -82.25 /-11.76 /-70.48 / /-24.95 -11.75/-1.68 8 [bos] the most bizarre situation . . [eos] tgt5: mod/noi/dif/loss/nce/logp -59.49 /-11.51 /-47.98 / /-2.44 -9.91 /-1.92 7 [bos] the most bizarre factory . [eos] cls0 - sp0 : -9.14 -1.83 6 0.00 [bos] : ! ! ! [eos] cls0 - sp1 : -9.24 -1.54 7 0.17 [bos] she ! ! ! . [eos] cls0 - sp2 : -9.31 -1.86 6 0.20 [bos] : ! ! ! [eos] cls0 - sp3 : -9.44 -1.89 6 0.20 [bos] she ! ! ! [eos] cls0 - sp4 : -9.54 -1.59 7 0.17 [bos] : ! ! ! . [eos] cls1 - sp0 : -9.22 -1.54 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp1 : -9.33 -1.56 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp2 : -9.37 -1.56 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp3 : -9.47 -1.58 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp4 : -9.62 -1.92 6 0.40 [bos] : ! ! ! [eos] cls2 - sp0 : -7.65 -1.28 7 0.67 [bos] she ! ! ! . [eos] cls2 - sp1 : -7.85 -1.31 7 0.67 [bos] she ! ! ! ! [eos] cls2 - sp2 : -7.97 -1.33 7 0.67 [bos] she ! ! ! ! [eos] cls2 - sp3 : -8.26 -1.38 7 0.50 [bos] she ! ! ! . [eos] cls2 - sp4 : -8.49 -1.42 7 0.67 [bos] she ! ! ! ! [eos] cls3 - sp0 : -6.36 -1.06 7 0.83 [bos] she ! ! ! ! [eos] cls3 - sp1 : -7.06 -1.18 7 0.83 [bos] she ! ! ! . [eos] cls3 - sp2 : -7.56 -1.26 7 1.00 [bos] she ! ! ! ! [eos] cls3 - sp3 : -8.26 -1.38 7 0.83 [bos] she ! ! later . [eos] cls3 - sp4 : -8.35 -1.39 7 1.00 [bos] she ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-186 src: none none 7 [bos] the most bizarre situation . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.79 /-0.63 /-34.16 /1.02/-1.02 -5.80 /-0.11 7 [bos] the most bizarre situation . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.79 /-0.63 /-34.16 / /-1.02 -5.80 /-0.11 7 [bos] the most bizarre situation . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.77 /-12.02 /-43.75 / /-10.61 -9.30 /-2.00 7 [bos] the external bizarre situation . [eos] tgt3: mod/noi/dif/loss/nce/logp -62.58 /-11.57 /-51.02 / /-17.88 -12.52/-2.31 6 [bos] the most bizarre situation [eos] tgt4: mod/noi/dif/loss/nce/logp -67.31 /-11.76 /-55.55 / /-22.41 -9.62 /-1.68 8 [bos] the most bizarre situation . . [eos] tgt5: mod/noi/dif/loss/nce/logp -45.91 /-11.51 /-34.40 / /-1.27 -7.65 /-1.92 7 [bos] the most bizarre factory . [eos] cls0 - sp0 : -8.69 -1.45 7 0.17 [bos] she ! ! ! . [eos] cls0 - sp1 : -8.94 -1.49 7 0.00 [bos] she ! ! ! . [eos] cls0 - sp2 : -8.95 -1.79 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -9.18 -1.53 7 0.17 [bos] she ! ! ! . [eos] cls0 - sp4 : -9.44 -1.89 6 0.20 [bos] she ! ! ! [eos] cls1 - sp0 : -8.35 -1.39 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp1 : -8.65 -1.44 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp2 : -8.72 -1.45 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp3 : -9.33 -1.55 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp4 : -9.70 -1.62 7 0.33 [bos] she ! ! ! ! [eos] cls2 - sp0 : -7.63 -1.27 7 0.67 [bos] she ! ! ! . [eos] cls2 - sp1 : -7.82 -1.30 7 0.50 [bos] she ! ! ! . [eos] cls2 - sp2 : -8.01 -1.33 7 0.67 [bos] she ! ! ! ! [eos] cls2 - sp3 : -8.12 -1.35 7 0.50 [bos] she ! ! ! . [eos] cls2 - sp4 : -8.43 -1.41 7 0.67 [bos] she ! ! ! ! [eos] cls3 - sp0 : -7.09 -1.18 7 0.83 [bos] she ! ! ! ! [eos] cls3 - sp1 : -7.59 -1.27 7 0.83 [bos] she ! ! ! . [eos] cls3 - sp2 : -7.93 -1.32 7 1.00 [bos] she ! ! ! ! [eos] cls3 - sp3 : -8.54 -1.42 7 0.83 [bos] she ! ! later . [eos] cls3 - sp4 : -8.71 -1.45 7 1.00 [bos] she ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-187 src: none none 7 [bos] the most bizarre situation . [eos] tgt0: mod/noi/dif/loss/nce/logp -48.42 /-0.63 /-47.79 /0.75/-0.75 -8.07 /-0.11 7 [bos] the most bizarre situation . [eos] tgt1: mod/noi/dif/loss/nce/logp -48.42 /-0.63 /-47.79 / /-0.75 -8.07 /-0.11 7 [bos] the most bizarre situation . [eos] tgt2: mod/noi/dif/loss/nce/logp -71.31 /-12.02 /-59.29 / /-12.24 -11.89/-2.00 7 [bos] the external bizarre situation . [eos] tgt3: mod/noi/dif/loss/nce/logp -79.63 /-11.57 /-68.06 / /-21.02 -15.93/-2.31 6 [bos] the most bizarre situation [eos] tgt4: mod/noi/dif/loss/nce/logp -82.52 /-11.76 /-70.76 / /-23.72 -11.79/-1.68 8 [bos] the most bizarre situation . . [eos] tgt5: mod/noi/dif/loss/nce/logp -61.44 /-11.51 /-49.93 / /-2.89 -10.24/-1.92 7 [bos] the most bizarre factory . [eos] cls0 - sp0 : -8.69 -1.45 7 0.17 [bos] she ! ! ! . [eos] cls0 - sp1 : -8.94 -1.49 7 0.00 [bos] she ! ! ! . [eos] cls0 - sp2 : -8.95 -1.79 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -9.18 -1.53 7 0.17 [bos] she ! ! ! . [eos] cls0 - sp4 : -9.44 -1.89 6 0.20 [bos] she ! ! ! [eos] cls1 - sp0 : -8.35 -1.39 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp1 : -8.65 -1.44 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp2 : -8.72 -1.45 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp3 : -9.33 -1.55 7 0.33 [bos] she ! ! ! . [eos] cls1 - sp4 : -9.70 -1.62 7 0.33 [bos] she ! ! ! ! [eos] cls2 - sp0 : -7.63 -1.27 7 0.67 [bos] she ! ! ! . [eos] cls2 - sp1 : -7.82 -1.30 7 0.50 [bos] she ! ! ! . [eos] cls2 - sp2 : -8.01 -1.33 7 0.67 [bos] she ! ! ! ! [eos] cls2 - sp3 : -8.12 -1.35 7 0.50 [bos] she ! ! ! . [eos] cls2 - sp4 : -8.43 -1.41 7 0.67 [bos] she ! ! ! ! [eos] cls3 - sp0 : -7.09 -1.18 7 0.83 [bos] she ! ! ! ! [eos] cls3 - sp1 : -7.59 -1.27 7 0.83 [bos] she ! ! ! . [eos] cls3 - sp2 : -7.93 -1.32 7 1.00 [bos] she ! ! ! ! [eos] cls3 - sp3 : -8.54 -1.42 7 0.83 [bos] she ! ! later . [eos] cls3 - sp4 : -8.71 -1.45 7 1.00 [bos] she ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-188 src: none none 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt0: mod/noi/dif/loss/nce/logp -165.69/-4.17 /-161.52/0.69/-0.69 -4.25 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt1: mod/noi/dif/loss/nce/logp -165.69/-4.17 /-161.52/ /-0.69 -4.25 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt2: mod/noi/dif/loss/nce/logp -276.24/-11.58 /-264.66/ /-103.83 -25.11/-1.05 12 [bos] furthermore , he could go on repeating the maneuver endlessly [eos] tgt3: mod/noi/dif/loss/nce/logp -189.68/-16.00 /-173.68/ /-12.85 -4.86 /-0.41 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to fifty shorts . [eos] tgt4: mod/noi/dif/loss/nce/logp -190.79/-15.21 /-175.58/ /-14.76 -4.89 /-0.39 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or the [unk] , or maybe a [unk] , next to his shorts . [eos] tgt5: mod/noi/dif/loss/nce/logp -204.20/-15.09 /-189.11/ /-28.28 -5.37 /-0.40 39 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts [eos] cls0 - sp0 : -64.62 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is other by he first in the governor's , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp1 : -64.63 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is other by he first in the cleaning , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp2 : -64.65 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is other by he first in the preceding , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp3 : -64.74 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is were by he first in the cleaning , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp4 : -64.75 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is were by he first in the governor's , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls1 - sp0 : -92.39 -2.37 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the indifferent , he may , a i or a [unk] , or new a [unk] , `` to his 7 . [eos] cls1 - sp1 : -92.45 -2.37 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the indifferent , he may , a i or a [unk] , or new a [unk] , but to his 7 . [eos] cls1 - sp2 : -92.60 -2.37 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the telephone , he may , a i or a [unk] , or new a [unk] , `` to his 7 . [eos] cls1 - sp3 : -92.66 -2.38 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the telephone , he may , a i or a [unk] , or new a [unk] , but to his 7 . [eos] cls1 - sp4 : -92.69 -2.38 40 0.26 [bos] '' , he were will on fractions the superiors deck '' were by he first in the indifferent , he may , a i or a [unk] , or new a [unk] , `` to his 7 . [eos] cls2 - sp0 : -92.02 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the streets , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp1 : -92.11 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the sponsored , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp2 : -92.15 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the mississippi , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp3 : -92.22 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the telephone , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp4 : -92.26 -2.37 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he first in the streets , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls3 - sp0 : -70.98 -1.82 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the streets , he could streets a streets or a [unk] , or state a [unk] , `` to his example . [eos] cls3 - sp1 : -71.06 -1.82 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the example , he could streets a streets or a [unk] , or state a [unk] , `` to his example . [eos] cls3 - sp2 : -71.12 -1.82 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the streets , he could streets a streets or a [unk] , or state a [unk] , `` to his almost . [eos] cls3 - sp3 : -71.19 -1.83 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the state , he could streets a streets or a [unk] , or state a [unk] , `` to his example . [eos] cls3 - sp4 : -71.20 -1.83 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the example , he could streets a streets or a [unk] , or state a [unk] , `` to his almost . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-189 src: none none 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt0: mod/noi/dif/loss/nce/logp -161.56/-4.17 /-157.39/0.69/-0.69 -4.14 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt1: mod/noi/dif/loss/nce/logp -161.56/-4.17 /-157.39/ /-0.69 -4.14 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt2: mod/noi/dif/loss/nce/logp -271.08/-11.58 /-259.50/ /-102.81 -24.64/-1.05 12 [bos] furthermore , he could go on repeating the maneuver endlessly [eos] tgt3: mod/noi/dif/loss/nce/logp -185.21/-16.00 /-169.21/ /-12.51 -4.75 /-0.41 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to fifty shorts . [eos] tgt4: mod/noi/dif/loss/nce/logp -184.10/-15.21 /-168.89/ /-12.19 -4.72 /-0.39 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or the [unk] , or maybe a [unk] , next to his shorts . [eos] tgt5: mod/noi/dif/loss/nce/logp -208.00/-15.09 /-192.91/ /-36.21 -5.47 /-0.40 39 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts [eos] cls0 - sp0 : -64.62 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is other by he first in the governor's , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp1 : -64.63 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is other by he first in the cleaning , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp2 : -64.65 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is other by he first in the preceding , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp3 : -64.74 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is were by he first in the cleaning , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls0 - sp4 : -64.75 -1.66 40 0.03 [bos] was , he were who on deck the expecting . is were by he first in the governor's , he may , a i or a [unk] , or new a [unk] , because to his own . [eos] cls1 - sp0 : -92.39 -2.37 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the indifferent , he may , a i or a [unk] , or new a [unk] , `` to his 7 . [eos] cls1 - sp1 : -92.45 -2.37 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the indifferent , he may , a i or a [unk] , or new a [unk] , but to his 7 . [eos] cls1 - sp2 : -92.60 -2.37 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the telephone , he may , a i or a [unk] , or new a [unk] , `` to his 7 . [eos] cls1 - sp3 : -92.66 -2.38 40 0.26 [bos] '' , he were will on fractions the superiors organized '' were by he first in the telephone , he may , a i or a [unk] , or new a [unk] , but to his 7 . [eos] cls1 - sp4 : -92.69 -2.38 40 0.26 [bos] '' , he were will on fractions the superiors deck '' were by he first in the indifferent , he may , a i or a [unk] , or new a [unk] , `` to his 7 . [eos] cls2 - sp0 : -92.02 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the streets , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp1 : -92.11 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the sponsored , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp2 : -92.15 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the mississippi , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp3 : -92.22 -2.36 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he thought in the telephone , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls2 - sp4 : -92.26 -2.37 40 0.74 [bos] '' , he were will on poet the mid-thirties thought to were by he first in the streets , he could streets a gloomy or a [unk] , or people a [unk] , `` to his almost . [eos] cls3 - sp0 : -70.98 -1.82 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the streets , he could streets a streets or a [unk] , or state a [unk] , `` to his example . [eos] cls3 - sp1 : -71.06 -1.82 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the example , he could streets a streets or a [unk] , or state a [unk] , `` to his example . [eos] cls3 - sp2 : -71.12 -1.82 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the streets , he could streets a streets or a [unk] , or state a [unk] , `` to his almost . [eos] cls3 - sp3 : -71.19 -1.83 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the state , he could streets a streets or a [unk] , or state a [unk] , `` to his example . [eos] cls3 - sp4 : -71.20 -1.83 40 1.00 [bos] was , he only who on state the crime people '' were which he first in the example , he could streets a streets or a [unk] , or state a [unk] , `` to his almost . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-190 src: none none 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt0: mod/noi/dif/loss/nce/logp -153.83/-4.17 /-149.66/0.69/-0.69 -3.94 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt1: mod/noi/dif/loss/nce/logp -153.83/-4.17 /-149.66/ /-0.69 -3.94 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt2: mod/noi/dif/loss/nce/logp -263.90/-11.58 /-252.32/ /-103.36 -23.99/-1.05 12 [bos] furthermore , he could go on repeating the maneuver endlessly [eos] tgt3: mod/noi/dif/loss/nce/logp -177.31/-16.00 /-161.32/ /-12.35 -4.55 /-0.41 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to fifty shorts . [eos] tgt4: mod/noi/dif/loss/nce/logp -177.89/-15.21 /-162.68/ /-13.72 -4.56 /-0.39 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or the [unk] , or maybe a [unk] , next to his shorts . [eos] tgt5: mod/noi/dif/loss/nce/logp -192.26/-15.09 /-177.18/ /-28.21 -5.06 /-0.40 39 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts [eos] cls0 - sp0 : -67.22 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may new a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls0 - sp1 : -67.23 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may new a streets or a [unk] , or be a [unk] , into to his preceding . [eos] cls0 - sp2 : -67.24 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may because a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls0 - sp3 : -67.26 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may over a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls0 - sp4 : -67.26 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may they a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls1 - sp0 : -28.04 -2.80 11 0.40 [bos] : , he were later on walker the streets [eos] cls1 - sp1 : -28.14 -2.81 11 0.40 [bos] : , he were later on grandfather the streets [eos] cls1 - sp2 : -28.16 -2.82 11 0.40 [bos] : , he were later on minds the streets [eos] cls1 - sp3 : -28.40 -2.84 11 0.40 [bos] : , he were later on minds the decay [eos] cls1 - sp4 : -28.69 -2.87 11 0.40 [bos] : , he were later on minds the deck [eos] cls2 - sp0 : -95.15 -2.44 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his reliable . [eos] cls2 - sp1 : -95.22 -2.44 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his personal . [eos] cls2 - sp2 : -95.40 -2.45 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his wherever . [eos] cls2 - sp3 : -95.40 -2.45 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his corner . [eos] cls2 - sp4 : -95.44 -2.45 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his agree . [eos] cls3 - sp0 : -75.10 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and new a example or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp1 : -75.14 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and state a example or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp2 : -75.16 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and new a almost or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp3 : -75.17 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the telephone , he and new a example or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp4 : -75.19 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and state a almost or a [unk] , or example a [unk] example state to his example . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-191 src: none none 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt0: mod/noi/dif/loss/nce/logp -157.45/-4.17 /-153.28/0.69/-0.69 -4.04 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt1: mod/noi/dif/loss/nce/logp -157.45/-4.17 /-153.28/ /-0.69 -4.04 /-0.11 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts . [eos] tgt2: mod/noi/dif/loss/nce/logp -258.71/-11.58 /-247.13/ /-94.55 -23.52/-1.05 12 [bos] furthermore , he could go on repeating the maneuver endlessly [eos] tgt3: mod/noi/dif/loss/nce/logp -180.90/-16.00 /-164.90/ /-12.31 -4.64 /-0.41 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to fifty shorts . [eos] tgt4: mod/noi/dif/loss/nce/logp -178.26/-15.21 /-163.05/ /-10.47 -4.57 /-0.39 40 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or the [unk] , or maybe a [unk] , next to his shorts . [eos] tgt5: mod/noi/dif/loss/nce/logp -203.62/-15.09 /-188.53/ /-35.95 -5.36 /-0.40 39 [bos] furthermore , he could go on repeating the maneuver endlessly : every time he went in the bedroom , he could drop a slip or a [unk] , or maybe a [unk] , next to his shorts [eos] cls0 - sp0 : -67.22 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may new a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls0 - sp1 : -67.23 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may new a streets or a [unk] , or be a [unk] , into to his preceding . [eos] cls0 - sp2 : -67.24 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may because a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls0 - sp3 : -67.26 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may over a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls0 - sp4 : -67.26 -1.72 40 0.00 [bos] : , he were than on streets the streets skywave is general any he first in the streets , he may they a streets or a [unk] , or be a [unk] , are to his preceding . [eos] cls1 - sp0 : -28.04 -2.80 11 0.40 [bos] : , he were later on walker the streets [eos] cls1 - sp1 : -28.14 -2.81 11 0.40 [bos] : , he were later on grandfather the streets [eos] cls1 - sp2 : -28.16 -2.82 11 0.40 [bos] : , he were later on minds the streets [eos] cls1 - sp3 : -28.40 -2.84 11 0.40 [bos] : , he were later on minds the decay [eos] cls1 - sp4 : -28.69 -2.87 11 0.40 [bos] : , he were later on minds the deck [eos] cls2 - sp0 : -95.15 -2.44 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his reliable . [eos] cls2 - sp1 : -95.22 -2.44 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his personal . [eos] cls2 - sp2 : -95.40 -2.45 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his wherever . [eos] cls2 - sp3 : -95.40 -2.45 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his corner . [eos] cls2 - sp4 : -95.44 -2.45 40 0.74 [bos] : , he were later on boards the streets crime is were space he first in the telephone , he may but a laughed or a [unk] , or example a [unk] , state to his agree . [eos] cls3 - sp0 : -75.10 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and new a example or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp1 : -75.14 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and state a example or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp2 : -75.16 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and new a almost or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp3 : -75.17 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the telephone , he and new a example or a [unk] , or example a [unk] example state to his example . [eos] cls3 - sp4 : -75.19 -1.93 40 1.00 [bos] : , he were our on streets the streets crime is new space he first in the streets , he and state a almost or a [unk] , or example a [unk] example state to his example . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-192 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -116.40/-1.85 /-114.55/0.69/-0.69 -6.13 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -116.40/-1.85 /-114.55/ /-0.69 -6.13 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -150.57/-12.84 /-137.73/ /-23.87 -8.37 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -151.93/-13.01 /-138.92/ /-25.06 -7.60 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -140.08/-12.58 /-127.50/ /-13.64 -7.37 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -135.43/-12.42 /-123.00/ /-9.15 -7.13 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -37.36 -2.20 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp1 : -38.90 -2.29 18 0.00 [bos] she streets that later was not be are patience to ! the first editor of her [eos] cls0 - sp2 : -39.36 -2.32 18 0.06 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp3 : -39.82 -2.34 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of her [eos] cls0 - sp4 : -39.86 -2.34 18 0.00 [bos] she streets that later was not be are patience to pain the first editor of her [eos] cls1 - sp0 : -36.42 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp1 : -36.44 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -36.45 -2.14 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -36.48 -2.15 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -36.59 -2.15 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -32.15 -1.89 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -32.45 -1.91 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -33.37 -1.96 18 0.65 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -30.88 -1.82 18 0.82 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -31.18 -1.83 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -31.65 -1.98 17 0.81 [bos] ! ! that ! : ! be ! ! to ! the ! ! ? [eos] cls3 - sp3 : -31.94 -1.88 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp4 : -32.35 -1.90 18 1.00 [bos] she personal that personal : not be ! ! to ! the ! ! of ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-193 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -128.67/-1.85 /-126.83/0.69/-0.69 -6.77 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -128.67/-1.85 /-126.83/ /-0.69 -6.77 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -166.13/-12.84 /-153.29/ /-27.15 -9.23 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -164.05/-13.01 /-151.05/ /-24.91 -8.20 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -151.85/-12.58 /-139.27/ /-13.14 -7.99 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -146.87/-12.42 /-134.45/ /-8.32 -7.73 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -37.36 -2.20 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp1 : -38.90 -2.29 18 0.00 [bos] she streets that later was not be are patience to ! the first editor of her [eos] cls0 - sp2 : -39.36 -2.32 18 0.06 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp3 : -39.82 -2.34 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of her [eos] cls0 - sp4 : -39.86 -2.34 18 0.00 [bos] she streets that later was not be are patience to pain the first editor of her [eos] cls1 - sp0 : -36.42 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp1 : -36.44 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -36.45 -2.14 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -36.48 -2.15 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -36.59 -2.15 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -32.15 -1.89 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -32.45 -1.91 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -33.37 -1.96 18 0.65 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -30.88 -1.82 18 0.82 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -31.18 -1.83 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -31.65 -1.98 17 0.81 [bos] ! ! that ! : ! be ! ! to ! the ! ! ? [eos] cls3 - sp3 : -31.94 -1.88 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp4 : -32.35 -1.90 18 1.00 [bos] she personal that personal : not be ! ! to ! the ! ! of ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-194 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -115.30/-1.85 /-113.45/0.69/-0.69 -6.07 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -115.30/-1.85 /-113.45/ /-0.69 -6.07 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -148.39/-12.84 /-135.55/ /-22.79 -8.24 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -151.39/-13.01 /-138.38/ /-25.62 -7.57 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -138.55/-12.58 /-125.98/ /-13.22 -7.29 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -134.42/-12.42 /-122.00/ /-9.24 -7.07 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -40.77 -2.15 20 0.00 [bos] she couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp1 : -40.78 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the streets ! of her firms . [eos] cls0 - sp2 : -40.79 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp3 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined streets of her firms . [eos] cls0 - sp4 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined couldn't of her firms . [eos] cls1 - sp0 : -25.30 -2.81 10 0.33 [bos] ! ! that ! : not be ! [eos] cls1 - sp1 : -35.24 -2.07 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -35.44 -2.08 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -35.57 -2.09 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -35.61 -2.09 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -33.60 -1.98 18 0.59 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -34.13 -2.01 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -34.57 -2.03 18 0.65 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -34.86 -2.05 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -35.28 -2.08 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -32.89 -1.93 18 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -33.50 -1.97 18 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -33.66 -1.98 18 1.00 [bos] it don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp3 : -34.93 -1.84 20 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! ! . [eos] cls3 - sp4 : -35.00 -1.84 20 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-195 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -125.70/-1.85 /-123.85/0.69/-0.69 -6.62 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -125.70/-1.85 /-123.85/ /-0.69 -6.62 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -161.64/-12.84 /-148.80/ /-25.64 -8.98 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -160.91/-13.01 /-147.91/ /-24.75 -8.05 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -148.26/-12.58 /-135.68/ /-12.52 -7.80 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -144.44/-12.42 /-132.02/ /-8.86 -7.60 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -40.77 -2.15 20 0.00 [bos] she couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp1 : -40.78 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the streets ! of her firms . [eos] cls0 - sp2 : -40.79 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp3 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined streets of her firms . [eos] cls0 - sp4 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined couldn't of her firms . [eos] cls1 - sp0 : -25.30 -2.81 10 0.33 [bos] ! ! that ! : not be ! [eos] cls1 - sp1 : -35.24 -2.07 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -35.44 -2.08 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -35.57 -2.09 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -35.61 -2.09 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -33.60 -1.98 18 0.59 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -34.13 -2.01 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -34.57 -2.03 18 0.65 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -34.86 -2.05 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -35.28 -2.08 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -32.89 -1.93 18 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -33.50 -1.97 18 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -33.66 -1.98 18 1.00 [bos] it don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp3 : -34.93 -1.84 20 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! ! . [eos] cls3 - sp4 : -35.00 -1.84 20 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-196 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -116.40/-1.85 /-114.55/0.69/-0.69 -6.13 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -116.40/-1.85 /-114.55/ /-0.69 -6.13 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -150.57/-12.84 /-137.73/ /-23.87 -8.37 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -151.93/-13.01 /-138.92/ /-25.06 -7.60 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -140.08/-12.58 /-127.50/ /-13.64 -7.37 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -135.43/-12.42 /-123.00/ /-9.15 -7.13 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -37.36 -2.20 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp1 : -38.90 -2.29 18 0.00 [bos] she streets that later was not be are patience to ! the first editor of her [eos] cls0 - sp2 : -39.36 -2.32 18 0.06 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp3 : -39.82 -2.34 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of her [eos] cls0 - sp4 : -39.86 -2.34 18 0.00 [bos] she streets that later was not be are patience to pain the first editor of her [eos] cls1 - sp0 : -36.42 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp1 : -36.44 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -36.45 -2.14 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -36.48 -2.15 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -36.59 -2.15 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -32.15 -1.89 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -32.45 -1.91 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -33.37 -1.96 18 0.65 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -30.88 -1.82 18 0.82 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -31.18 -1.83 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -31.65 -1.98 17 0.81 [bos] ! ! that ! : ! be ! ! to ! the ! ! ? [eos] cls3 - sp3 : -31.94 -1.88 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp4 : -32.35 -1.90 18 1.00 [bos] she personal that personal : not be ! ! to ! the ! ! of ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-197 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -128.67/-1.85 /-126.83/0.69/-0.69 -6.77 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -128.67/-1.85 /-126.83/ /-0.69 -6.77 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -166.13/-12.84 /-153.29/ /-27.15 -9.23 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -164.05/-13.01 /-151.05/ /-24.91 -8.20 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -151.85/-12.58 /-139.27/ /-13.14 -7.99 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -146.87/-12.42 /-134.45/ /-8.32 -7.73 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -37.36 -2.20 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp1 : -38.90 -2.29 18 0.00 [bos] she streets that later was not be are patience to ! the first editor of her [eos] cls0 - sp2 : -39.36 -2.32 18 0.06 [bos] she streets that later : not be are patience to pain the first editor of property [eos] cls0 - sp3 : -39.82 -2.34 18 0.00 [bos] she streets that later : not be are patience to pain the first editor of her [eos] cls0 - sp4 : -39.86 -2.34 18 0.00 [bos] she streets that later was not be are patience to pain the first editor of her [eos] cls1 - sp0 : -36.42 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp1 : -36.44 -2.14 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -36.45 -2.14 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -36.48 -2.15 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -36.59 -2.15 18 0.41 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -32.15 -1.89 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -32.45 -1.91 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -33.37 -1.96 18 0.65 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -33.40 -1.96 18 0.71 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -30.88 -1.82 18 0.82 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -31.18 -1.83 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -31.65 -1.98 17 0.81 [bos] ! ! that ! : ! be ! ! to ! the ! ! ? [eos] cls3 - sp3 : -31.94 -1.88 18 0.76 [bos] ! ! that ! : ! be ! ! to ! the ! ! of ! [eos] cls3 - sp4 : -32.35 -1.90 18 1.00 [bos] she personal that personal : not be ! ! to ! the ! ! of ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-198 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -115.30/-1.85 /-113.45/0.69/-0.69 -6.07 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -115.30/-1.85 /-113.45/ /-0.69 -6.07 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -148.39/-12.84 /-135.55/ /-22.79 -8.24 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -151.39/-13.01 /-138.38/ /-25.62 -7.57 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -138.55/-12.58 /-125.98/ /-13.22 -7.29 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -134.42/-12.42 /-122.00/ /-9.24 -7.07 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -40.77 -2.15 20 0.00 [bos] she couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp1 : -40.78 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the streets ! of her firms . [eos] cls0 - sp2 : -40.79 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp3 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined streets of her firms . [eos] cls0 - sp4 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined couldn't of her firms . [eos] cls1 - sp0 : -25.30 -2.81 10 0.33 [bos] ! ! that ! : not be ! [eos] cls1 - sp1 : -35.24 -2.07 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -35.44 -2.08 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -35.57 -2.09 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -35.61 -2.09 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -33.60 -1.98 18 0.59 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -34.13 -2.01 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -34.57 -2.03 18 0.65 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -34.86 -2.05 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -35.28 -2.08 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -32.89 -1.93 18 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -33.50 -1.97 18 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -33.66 -1.98 18 1.00 [bos] it don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp3 : -34.93 -1.84 20 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! ! . [eos] cls3 - sp4 : -35.00 -1.84 20 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-199 src: none none 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt0: mod/noi/dif/loss/nce/logp -125.70/-1.85 /-123.85/0.69/-0.69 -6.62 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt1: mod/noi/dif/loss/nce/logp -125.70/-1.85 /-123.85/ /-0.69 -6.62 /-0.10 20 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . [eos] tgt2: mod/noi/dif/loss/nce/logp -161.64/-12.84 /-148.80/ /-25.64 -8.98 /-0.71 19 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story [eos] tgt3: mod/noi/dif/loss/nce/logp -160.91/-13.01 /-147.91/ /-24.75 -8.05 /-0.65 21 [bos] martin guessed that dolores would not be so eager to tell the next installment of her story . . [eos] tgt4: mod/noi/dif/loss/nce/logp -148.26/-12.58 /-135.68/ /-12.52 -7.80 /-0.66 20 [bos] martin guessed that dolores would not , so eager to tell the next installment of her story . [eos] tgt5: mod/noi/dif/loss/nce/logp -144.44/-12.42 /-132.02/ /-8.86 -7.60 /-0.65 20 [bos] martin guessed that dolores would , be so eager to tell the next installment of her story . [eos] cls0 - sp0 : -40.77 -2.15 20 0.00 [bos] she couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp1 : -40.78 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the streets ! of her firms . [eos] cls0 - sp2 : -40.79 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined ! of her firms . [eos] cls0 - sp3 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined streets of her firms . [eos] cls0 - sp4 : -40.81 -2.15 20 0.00 [bos] it couldn't that later : not be are cleaning to ! the joined couldn't of her firms . [eos] cls1 - sp0 : -25.30 -2.81 10 0.33 [bos] ! ! that ! : not be ! [eos] cls1 - sp1 : -35.24 -2.07 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp2 : -35.44 -2.08 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp3 : -35.57 -2.09 18 0.47 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls1 - sp4 : -35.61 -2.09 18 0.35 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp0 : -33.60 -1.98 18 0.59 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp1 : -34.13 -2.01 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp2 : -34.57 -2.03 18 0.65 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp3 : -34.86 -2.05 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls2 - sp4 : -35.28 -2.08 18 0.53 [bos] ! ! that ! : not be ! ! to ! the ! ! of ! [eos] cls3 - sp0 : -32.89 -1.93 18 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! [eos] cls3 - sp1 : -33.50 -1.97 18 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp2 : -33.66 -1.98 18 1.00 [bos] it don't that later : not be ! ! to ! the ! ! of ! [eos] cls3 - sp3 : -34.93 -1.84 20 1.00 [bos] we don't that later : not be ! ! to ! the ! ! of ! ! . [eos] cls3 - sp4 : -35.00 -1.84 20 1.00 [bos] we don't that personal : not be ! ! to ! the ! ! of ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-200 src: none none 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt0: mod/noi/dif/loss/nce/logp -152.27/-2.07 /-150.20/14.46/-14.46 -6.92 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt1: mod/noi/dif/loss/nce/logp -152.27/-2.07 /-150.20/ /-14.46 -6.92 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt2: mod/noi/dif/loss/nce/logp -193.29/-13.05 /-180.24/ /-44.51 -9.20 /-0.62 22 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay [eos] tgt3: mod/noi/dif/loss/nce/logp -174.15/-12.94 /-161.21/ /-25.48 -7.92 /-0.59 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts , shoals and clay . [eos] tgt4: mod/noi/dif/loss/nce/logp -149.56/-13.83 /-135.73/ /-0.00 -6.80 /-0.63 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for fanned and clay . [eos] tgt5: mod/noi/dif/loss/nce/logp -188.05/-13.20 /-174.85/ /-39.11 -8.18 /-0.57 24 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . . [eos] cls0 - sp0 : -46.22 -2.57 19 0.06 [bos] we streets couldn't , rome joined into the later of streets cleaning and ! all cleaning for [eos] cls0 - sp1 : -46.46 -2.58 19 0.06 [bos] we streets couldn't , rome joined into the later of streets telephone and ! all cleaning for [eos] cls0 - sp2 : -46.48 -2.58 19 0.06 [bos] we streets first , later joined into the later of streets cleaning and ! all cleaning for [eos] cls0 - sp3 : -46.51 -2.58 19 0.06 [bos] we streets couldn't , world joined into the later of streets cleaning and ! all cleaning for [eos] cls0 - sp4 : -46.52 -2.58 19 0.06 [bos] we streets couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp0 : -50.90 -2.83 19 0.28 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp1 : -52.89 -2.94 19 0.33 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp2 : -53.21 -2.96 19 0.28 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp3 : -53.64 -2.98 19 0.28 [bos] ! telephone couldn't , later joined into the later of editor cleaning and ! all cleaning for [eos] cls1 - sp4 : -53.69 -2.98 19 0.28 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all joined for [eos] cls2 - sp0 : -48.78 -2.71 19 0.50 [bos] ! telephone couldn't , rome don't into the later of corner bidding and ! all telephone for [eos] cls2 - sp1 : -48.83 -2.71 19 0.50 [bos] ! telephone couldn't , rome don't into the later of corner bidding and ! all discussed for [eos] cls2 - sp2 : -48.85 -2.71 19 0.50 [bos] ! telephone couldn't , rome don't have the later of corner bidding and ! all telephone for [eos] cls2 - sp3 : -48.90 -2.72 19 0.50 [bos] ! telephone couldn't , rome don't have the later of corner bidding and ! all discussed for [eos] cls2 - sp4 : -49.34 -2.74 19 0.50 [bos] ! telephone couldn't , world don't into the later of corner bidding and ! all telephone for [eos] cls3 - sp0 : -53.35 -2.43 23 1.00 [bos] no almost first , later way have the later of corner telephone and ! all telephone for center and rome . [eos] cls3 - sp1 : -53.39 -2.43 23 1.00 [bos] no almost first , later made have the later of corner telephone and ! all telephone for center and rome . [eos] cls3 - sp2 : -53.41 -2.43 23 1.00 [bos] no almost first , later made have the later of corner first and ! all telephone for center and rome . [eos] cls3 - sp3 : -53.41 -2.43 23 1.00 [bos] no almost first , later made have the later of corner almost and ! all telephone for center and rome . [eos] cls3 - sp4 : -53.44 -2.43 23 1.00 [bos] no almost first , later way have the later of corner almost and ! all telephone for center and rome . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-201 src: none none 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt0: mod/noi/dif/loss/nce/logp -150.73/-2.07 /-148.66/13.28/-13.28 -6.85 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt1: mod/noi/dif/loss/nce/logp -150.73/-2.07 /-148.66/ /-13.28 -6.85 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt2: mod/noi/dif/loss/nce/logp -194.98/-13.05 /-181.93/ /-46.55 -9.28 /-0.62 22 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay [eos] tgt3: mod/noi/dif/loss/nce/logp -170.90/-12.94 /-157.96/ /-22.58 -7.77 /-0.59 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts , shoals and clay . [eos] tgt4: mod/noi/dif/loss/nce/logp -149.20/-13.83 /-135.38/ /-0.00 -6.78 /-0.63 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for fanned and clay . [eos] tgt5: mod/noi/dif/loss/nce/logp -184.83/-13.20 /-171.63/ /-36.25 -8.04 /-0.57 24 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . . [eos] cls0 - sp0 : -46.22 -2.57 19 0.06 [bos] we streets couldn't , rome joined into the later of streets cleaning and ! all cleaning for [eos] cls0 - sp1 : -46.46 -2.58 19 0.06 [bos] we streets couldn't , rome joined into the later of streets telephone and ! all cleaning for [eos] cls0 - sp2 : -46.48 -2.58 19 0.06 [bos] we streets first , later joined into the later of streets cleaning and ! all cleaning for [eos] cls0 - sp3 : -46.51 -2.58 19 0.06 [bos] we streets couldn't , world joined into the later of streets cleaning and ! all cleaning for [eos] cls0 - sp4 : -46.52 -2.58 19 0.06 [bos] we streets couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp0 : -50.90 -2.83 19 0.28 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp1 : -52.89 -2.94 19 0.33 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp2 : -53.21 -2.96 19 0.28 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all cleaning for [eos] cls1 - sp3 : -53.64 -2.98 19 0.28 [bos] ! telephone couldn't , later joined into the later of editor cleaning and ! all cleaning for [eos] cls1 - sp4 : -53.69 -2.98 19 0.28 [bos] ! telephone couldn't , later joined into the later of streets cleaning and ! all joined for [eos] cls2 - sp0 : -48.78 -2.71 19 0.50 [bos] ! telephone couldn't , rome don't into the later of corner bidding and ! all telephone for [eos] cls2 - sp1 : -48.83 -2.71 19 0.50 [bos] ! telephone couldn't , rome don't into the later of corner bidding and ! all discussed for [eos] cls2 - sp2 : -48.85 -2.71 19 0.50 [bos] ! telephone couldn't , rome don't have the later of corner bidding and ! all telephone for [eos] cls2 - sp3 : -48.90 -2.72 19 0.50 [bos] ! telephone couldn't , rome don't have the later of corner bidding and ! all discussed for [eos] cls2 - sp4 : -49.34 -2.74 19 0.50 [bos] ! telephone couldn't , world don't into the later of corner bidding and ! all telephone for [eos] cls3 - sp0 : -53.35 -2.43 23 1.00 [bos] no almost first , later way have the later of corner telephone and ! all telephone for center and rome . [eos] cls3 - sp1 : -53.39 -2.43 23 1.00 [bos] no almost first , later made have the later of corner telephone and ! all telephone for center and rome . [eos] cls3 - sp2 : -53.41 -2.43 23 1.00 [bos] no almost first , later made have the later of corner first and ! all telephone for center and rome . [eos] cls3 - sp3 : -53.41 -2.43 23 1.00 [bos] no almost first , later made have the later of corner almost and ! all telephone for center and rome . [eos] cls3 - sp4 : -53.44 -2.43 23 1.00 [bos] no almost first , later way have the later of corner almost and ! all telephone for center and rome . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-202 src: none none 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt0: mod/noi/dif/loss/nce/logp -153.66/-2.07 /-151.59/14.66/-14.66 -6.98 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt1: mod/noi/dif/loss/nce/logp -153.66/-2.07 /-151.59/ /-14.66 -6.98 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt2: mod/noi/dif/loss/nce/logp -193.59/-13.05 /-180.54/ /-43.61 -9.22 /-0.62 22 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay [eos] tgt3: mod/noi/dif/loss/nce/logp -174.67/-12.94 /-161.72/ /-24.79 -7.94 /-0.59 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts , shoals and clay . [eos] tgt4: mod/noi/dif/loss/nce/logp -150.76/-13.83 /-136.93/ /-0.00 -6.85 /-0.63 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for fanned and clay . [eos] tgt5: mod/noi/dif/loss/nce/logp -188.86/-13.20 /-175.66/ /-38.73 -8.21 /-0.57 24 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . . [eos] cls0 - sp0 : -54.88 -2.49 23 0.00 [bos] we later first , its joined into the later of couldn't joined and ! she joined for patience and no . [eos] cls0 - sp1 : -56.19 -2.55 23 0.00 [bos] we later couldn't , its joined into the later of joined joined and ! she joined for cleaning and . ! [eos] cls0 - sp2 : -56.26 -2.56 23 0.00 [bos] we later first , its joined into the later of couldn't joined and ! she joined for cleaning and . ! [eos] cls0 - sp3 : -56.39 -2.56 23 0.00 [bos] we later first , its joined into the later of couldn't organized and ! she joined for cleaning and . ! [eos] cls0 - sp4 : -56.47 -2.57 23 0.00 [bos] we later couldn't , its joined into the later of joined joined and ! she joined for patience and . ! [eos] cls1 - sp0 : -62.69 -2.85 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she joined for cleaning and . ! [eos] cls1 - sp1 : -62.89 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she cleaning for mid-thirties and . ! [eos] cls1 - sp2 : -62.91 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she cleaning for bidding and . ! [eos] cls1 - sp3 : -62.91 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she cleaning for landed and . ! [eos] cls1 - sp4 : -62.93 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she joined for mid-thirties and . ! [eos] cls2 - sp0 : -60.96 -2.77 23 0.64 [bos] we dr. don't , its telephone into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp1 : -60.97 -2.77 23 0.64 [bos] we dr. don't , its discussed into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp2 : -61.06 -2.78 23 0.68 [bos] we dr. don't , its telephone into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp3 : -61.08 -2.78 23 0.68 [bos] we dr. don't , its discussed into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp4 : -61.25 -2.78 23 0.68 [bos] we dr. don't , its telephone into the later of corner thousand and ! she telephone for telephone and don't . [eos] cls3 - sp0 : -54.91 -2.50 23 1.00 [bos] no later first , this corner into the later of corner telephone and corner she telephone for telephone and rome . [eos] cls3 - sp1 : -54.94 -2.50 23 1.00 [bos] no later first , later corner into the later of corner telephone and corner she telephone for telephone and rome . [eos] cls3 - sp2 : -54.99 -2.50 23 1.00 [bos] no later first , this corner into the later of corner telephone and corner she telephone for mississippi and rome . [eos] cls3 - sp3 : -55.02 -2.50 23 1.00 [bos] no later first , later corner into the later of corner telephone and corner she telephone for mississippi and rome . [eos] cls3 - sp4 : -55.07 -2.50 23 1.00 [bos] no later first , this corner into the later of corner telephone and corner she telephone for telephone and don't . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-203 src: none none 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt0: mod/noi/dif/loss/nce/logp -151.14/-2.07 /-149.07/13.11/-13.11 -6.87 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt1: mod/noi/dif/loss/nce/logp -151.14/-2.07 /-149.07/ /-13.11 -6.87 /-0.09 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . [eos] tgt2: mod/noi/dif/loss/nce/logp -194.51/-13.05 /-181.47/ /-45.50 -9.26 /-0.62 22 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay [eos] tgt3: mod/noi/dif/loss/nce/logp -171.03/-12.94 /-158.09/ /-22.13 -7.77 /-0.59 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts , shoals and clay . [eos] tgt4: mod/noi/dif/loss/nce/logp -149.79/-13.83 /-135.96/ /-0.00 -6.81 /-0.63 23 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for fanned and clay . [eos] tgt5: mod/noi/dif/loss/nce/logp -185.09/-13.20 /-171.89/ /-35.93 -8.05 /-0.57 24 [bos] through jack hamrick , william fell into the world of automobile promotion and got several accounts for shoals and clay . . [eos] cls0 - sp0 : -54.88 -2.49 23 0.00 [bos] we later first , its joined into the later of couldn't joined and ! she joined for patience and no . [eos] cls0 - sp1 : -56.19 -2.55 23 0.00 [bos] we later couldn't , its joined into the later of joined joined and ! she joined for cleaning and . ! [eos] cls0 - sp2 : -56.26 -2.56 23 0.00 [bos] we later first , its joined into the later of couldn't joined and ! she joined for cleaning and . ! [eos] cls0 - sp3 : -56.39 -2.56 23 0.00 [bos] we later first , its joined into the later of couldn't organized and ! she joined for cleaning and . ! [eos] cls0 - sp4 : -56.47 -2.57 23 0.00 [bos] we later couldn't , its joined into the later of joined joined and ! she joined for patience and . ! [eos] cls1 - sp0 : -62.69 -2.85 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she joined for cleaning and . ! [eos] cls1 - sp1 : -62.89 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she cleaning for mid-thirties and . ! [eos] cls1 - sp2 : -62.91 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she cleaning for bidding and . ! [eos] cls1 - sp3 : -62.91 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she cleaning for landed and . ! [eos] cls1 - sp4 : -62.93 -2.86 23 0.27 [bos] ! later don't , its joined into the later of couldn't organized and ! she joined for mid-thirties and . ! [eos] cls2 - sp0 : -60.96 -2.77 23 0.64 [bos] we dr. don't , its telephone into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp1 : -60.97 -2.77 23 0.64 [bos] we dr. don't , its discussed into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp2 : -61.06 -2.78 23 0.68 [bos] we dr. don't , its telephone into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp3 : -61.08 -2.78 23 0.68 [bos] we dr. don't , its discussed into the later of corner thousand and ! she telephone for mississippi and don't . [eos] cls2 - sp4 : -61.25 -2.78 23 0.68 [bos] we dr. don't , its telephone into the later of corner thousand and ! she telephone for telephone and don't . [eos] cls3 - sp0 : -54.91 -2.50 23 1.00 [bos] no later first , this corner into the later of corner telephone and corner she telephone for telephone and rome . [eos] cls3 - sp1 : -54.94 -2.50 23 1.00 [bos] no later first , later corner into the later of corner telephone and corner she telephone for telephone and rome . [eos] cls3 - sp2 : -54.99 -2.50 23 1.00 [bos] no later first , this corner into the later of corner telephone and corner she telephone for mississippi and rome . [eos] cls3 - sp3 : -55.02 -2.50 23 1.00 [bos] no later first , later corner into the later of corner telephone and corner she telephone for mississippi and rome . [eos] cls3 - sp4 : -55.07 -2.50 23 1.00 [bos] no later first , this corner into the later of corner telephone and corner she telephone for telephone and don't . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-204 src: none none 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt0: mod/noi/dif/loss/nce/logp -79.15 /-0.96 /-78.19 /11.7/-11.70 -7.20 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt1: mod/noi/dif/loss/nce/logp -79.15 /-0.96 /-78.19 / /-11.70 -7.20 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt2: mod/noi/dif/loss/nce/logp -79.35 /-12.86 /-66.50 / /-0.00 -7.21 /-1.17 12 [bos] stock willis held in altitude fell sharply in value . [eos] tgt3: mod/noi/dif/loss/nce/logp -116.41/-11.89 /-104.52/ /-38.03 -11.64/-1.19 11 [bos] stock willis held in abundance fell sharply in value [eos] tgt4: mod/noi/dif/loss/nce/logp -114.97/-12.17 /-102.80/ /-36.30 -9.58 /-1.01 13 [bos] stock willis held in abundance fell sharply in value . . [eos] tgt5: mod/noi/dif/loss/nce/logp -104.96/-12.04 /-92.93 / /-26.43 -9.54 /-1.09 12 [bos] stock willis held of abundance fell sharply in value . [eos] cls0 - sp0 : -11.83 -2.37 6 0.20 [bos] ! ! ! in [eos] cls0 - sp1 : -12.57 -2.51 6 0.20 [bos] she 7 ! in [eos] cls0 - sp2 : -13.76 -2.75 6 0.20 [bos] she streets ! in [eos] cls0 - sp3 : -14.00 -2.80 6 0.00 [bos] she streets ! in [eos] cls0 - sp4 : -15.37 -3.07 6 0.20 [bos] she streets ! in [eos] cls1 - sp0 : -11.59 -2.32 6 0.40 [bos] ! ! ! in [eos] cls1 - sp1 : -11.65 -2.33 6 0.40 [bos] ! ! ! in [eos] cls1 - sp2 : -12.52 -2.50 6 0.40 [bos] ! ! ! in [eos] cls1 - sp3 : -13.48 -2.70 6 0.40 [bos] she 7 ! in [eos] cls1 - sp4 : -13.53 -2.71 6 0.40 [bos] ! ! ! in [eos] cls2 - sp0 : -12.11 -2.42 6 0.60 [bos] ! ! ! in [eos] cls2 - sp1 : -12.79 -2.56 6 0.60 [bos] ! ! ! in [eos] cls2 - sp2 : -14.41 -2.88 6 0.60 [bos] ! ! ! in [eos] cls2 - sp3 : -14.75 -2.95 6 0.60 [bos] ! ! ! in [eos] cls2 - sp4 : -15.40 -3.08 6 0.60 [bos] ! ! ! in [eos] cls3 - sp0 : -12.70 -2.54 6 0.80 [bos] ! ! ! in [eos] cls3 - sp1 : -13.95 -2.79 6 0.80 [bos] ! 7 ! in [eos] cls3 - sp2 : -21.48 -1.95 12 0.91 [bos] ! ! ! in ! ! ! in ! . [eos] cls3 - sp3 : -21.73 -1.98 12 0.91 [bos] ! ! ! in ! ! ! in no . [eos] cls3 - sp4 : -21.88 -1.99 12 1.00 [bos] ! ! ! in ! ! ! in ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-205 src: none none 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt0: mod/noi/dif/loss/nce/logp -83.58 /-0.96 /-82.62 /10.19/-10.19 -7.60 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt1: mod/noi/dif/loss/nce/logp -83.58 /-0.96 /-82.62 / /-10.19 -7.60 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.28 /-12.86 /-72.42 / /-0.00 -7.75 /-1.17 12 [bos] stock willis held in altitude fell sharply in value . [eos] tgt3: mod/noi/dif/loss/nce/logp -126.05/-11.89 /-114.16/ /-41.74 -12.60/-1.19 11 [bos] stock willis held in abundance fell sharply in value [eos] tgt4: mod/noi/dif/loss/nce/logp -120.48/-12.17 /-108.30/ /-35.88 -10.04/-1.01 13 [bos] stock willis held in abundance fell sharply in value . . [eos] tgt5: mod/noi/dif/loss/nce/logp -110.44/-12.04 /-98.40 / /-25.98 -10.04/-1.09 12 [bos] stock willis held of abundance fell sharply in value . [eos] cls0 - sp0 : -11.83 -2.37 6 0.20 [bos] ! ! ! in [eos] cls0 - sp1 : -12.57 -2.51 6 0.20 [bos] she 7 ! in [eos] cls0 - sp2 : -13.76 -2.75 6 0.20 [bos] she streets ! in [eos] cls0 - sp3 : -14.00 -2.80 6 0.00 [bos] she streets ! in [eos] cls0 - sp4 : -15.37 -3.07 6 0.20 [bos] she streets ! in [eos] cls1 - sp0 : -11.59 -2.32 6 0.40 [bos] ! ! ! in [eos] cls1 - sp1 : -11.65 -2.33 6 0.40 [bos] ! ! ! in [eos] cls1 - sp2 : -12.52 -2.50 6 0.40 [bos] ! ! ! in [eos] cls1 - sp3 : -13.48 -2.70 6 0.40 [bos] she 7 ! in [eos] cls1 - sp4 : -13.53 -2.71 6 0.40 [bos] ! ! ! in [eos] cls2 - sp0 : -12.11 -2.42 6 0.60 [bos] ! ! ! in [eos] cls2 - sp1 : -12.79 -2.56 6 0.60 [bos] ! ! ! in [eos] cls2 - sp2 : -14.41 -2.88 6 0.60 [bos] ! ! ! in [eos] cls2 - sp3 : -14.75 -2.95 6 0.60 [bos] ! ! ! in [eos] cls2 - sp4 : -15.40 -3.08 6 0.60 [bos] ! ! ! in [eos] cls3 - sp0 : -12.70 -2.54 6 0.80 [bos] ! ! ! in [eos] cls3 - sp1 : -13.95 -2.79 6 0.80 [bos] ! 7 ! in [eos] cls3 - sp2 : -21.48 -1.95 12 0.91 [bos] ! ! ! in ! ! ! in ! . [eos] cls3 - sp3 : -21.73 -1.98 12 0.91 [bos] ! ! ! in ! ! ! in no . [eos] cls3 - sp4 : -21.88 -1.99 12 1.00 [bos] ! ! ! in ! ! ! in ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-206 src: none none 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt0: mod/noi/dif/loss/nce/logp -81.41 /-0.96 /-80.45 /11.95/-11.95 -7.40 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt1: mod/noi/dif/loss/nce/logp -81.41 /-0.96 /-80.45 / /-11.95 -7.40 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt2: mod/noi/dif/loss/nce/logp -81.35 /-12.86 /-68.50 / /-0.00 -7.40 /-1.17 12 [bos] stock willis held in altitude fell sharply in value . [eos] tgt3: mod/noi/dif/loss/nce/logp -116.23/-11.89 /-104.34/ /-35.84 -11.62/-1.19 11 [bos] stock willis held in abundance fell sharply in value [eos] tgt4: mod/noi/dif/loss/nce/logp -116.43/-12.17 /-104.26/ /-35.76 -9.70 /-1.01 13 [bos] stock willis held in abundance fell sharply in value . . [eos] tgt5: mod/noi/dif/loss/nce/logp -105.40/-12.04 /-93.36 / /-24.87 -9.58 /-1.09 12 [bos] stock willis held of abundance fell sharply in value . [eos] cls0 - sp0 : -15.15 -2.53 7 0.17 [bos] ! ! ! in ! [eos] cls0 - sp1 : -26.83 -2.44 12 0.18 [bos] ! ! ! in ! ! ! in ! . [eos] cls0 - sp2 : -27.02 -2.46 12 0.00 [bos] i any no in joined joined cleaning in ! . [eos] cls0 - sp3 : -27.04 -2.46 12 0.00 [bos] i any no in joined joined cleaning in later . [eos] cls0 - sp4 : -27.04 -2.46 12 0.00 [bos] i any no in mean joined cleaning in ! . [eos] cls1 - sp0 : -15.55 -2.59 7 0.33 [bos] ! ! ! in ! [eos] cls1 - sp1 : -15.66 -2.61 7 0.33 [bos] ! ! ! in ! [eos] cls1 - sp2 : -15.80 -2.63 7 0.33 [bos] ! ! ! in ! [eos] cls1 - sp3 : -16.67 -2.78 7 0.33 [bos] ! ) ! in ! [eos] cls1 - sp4 : -16.85 -2.81 7 0.33 [bos] ! ! ! in ! [eos] cls2 - sp0 : -14.37 -2.39 7 0.50 [bos] ! ! ! in ! [eos] cls2 - sp1 : -14.87 -2.48 7 0.67 [bos] ! ! ! in ! [eos] cls2 - sp2 : -15.20 -2.53 7 0.50 [bos] ! ) ! in ! [eos] cls2 - sp3 : -15.96 -2.66 7 0.67 [bos] ! ! ! in ! [eos] cls2 - sp4 : -16.41 -2.74 7 0.50 [bos] ! ? ! in ! [eos] cls3 - sp0 : -15.81 -2.64 7 0.83 [bos] ! ! ! in ! [eos] cls3 - sp1 : -16.51 -2.75 7 0.83 [bos] ! ! ! in ! [eos] cls3 - sp2 : -18.88 -1.72 12 0.91 [bos] ! ! ! in ! ! ! in ! . [eos] cls3 - sp3 : -19.53 -1.78 12 0.82 [bos] ! ! ! in ! ! ! in ! . [eos] cls3 - sp4 : -19.54 -1.78 12 1.00 [bos] ! ! ! in ! ! ! in ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-207 src: none none 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt0: mod/noi/dif/loss/nce/logp -85.20 /-0.96 /-84.24 /9.66/-9.66 -7.75 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt1: mod/noi/dif/loss/nce/logp -85.20 /-0.96 /-84.24 / /-9.66 -7.75 /-0.09 12 [bos] stock willis held in abundance fell sharply in value . [eos] tgt2: mod/noi/dif/loss/nce/logp -87.43 /-12.86 /-74.57 / /-0.00 -7.95 /-1.17 12 [bos] stock willis held in altitude fell sharply in value . [eos] tgt3: mod/noi/dif/loss/nce/logp -124.19/-11.89 /-112.31/ /-37.73 -12.42/-1.19 11 [bos] stock willis held in abundance fell sharply in value [eos] tgt4: mod/noi/dif/loss/nce/logp -121.72/-12.17 /-109.55/ /-34.97 -10.14/-1.01 13 [bos] stock willis held in abundance fell sharply in value . . [eos] tgt5: mod/noi/dif/loss/nce/logp -109.73/-12.04 /-97.69 / /-23.12 -9.98 /-1.09 12 [bos] stock willis held of abundance fell sharply in value . [eos] cls0 - sp0 : -15.15 -2.53 7 0.17 [bos] ! ! ! in ! [eos] cls0 - sp1 : -26.83 -2.44 12 0.18 [bos] ! ! ! in ! ! ! in ! . [eos] cls0 - sp2 : -27.02 -2.46 12 0.00 [bos] i any no in joined joined cleaning in ! . [eos] cls0 - sp3 : -27.04 -2.46 12 0.00 [bos] i any no in joined joined cleaning in later . [eos] cls0 - sp4 : -27.04 -2.46 12 0.00 [bos] i any no in mean joined cleaning in ! . [eos] cls1 - sp0 : -15.55 -2.59 7 0.33 [bos] ! ! ! in ! [eos] cls1 - sp1 : -15.66 -2.61 7 0.33 [bos] ! ! ! in ! [eos] cls1 - sp2 : -15.80 -2.63 7 0.33 [bos] ! ! ! in ! [eos] cls1 - sp3 : -16.67 -2.78 7 0.33 [bos] ! ) ! in ! [eos] cls1 - sp4 : -16.85 -2.81 7 0.33 [bos] ! ! ! in ! [eos] cls2 - sp0 : -14.37 -2.39 7 0.50 [bos] ! ! ! in ! [eos] cls2 - sp1 : -14.87 -2.48 7 0.67 [bos] ! ! ! in ! [eos] cls2 - sp2 : -15.20 -2.53 7 0.50 [bos] ! ) ! in ! [eos] cls2 - sp3 : -15.96 -2.66 7 0.67 [bos] ! ! ! in ! [eos] cls2 - sp4 : -16.41 -2.74 7 0.50 [bos] ! ? ! in ! [eos] cls3 - sp0 : -15.81 -2.64 7 0.83 [bos] ! ! ! in ! [eos] cls3 - sp1 : -16.51 -2.75 7 0.83 [bos] ! ! ! in ! [eos] cls3 - sp2 : -18.88 -1.72 12 0.91 [bos] ! ! ! in ! ! ! in ! . [eos] cls3 - sp3 : -19.53 -1.78 12 0.82 [bos] ! ! ! in ! ! ! in ! . [eos] cls3 - sp4 : -19.54 -1.78 12 1.00 [bos] ! ! ! in ! ! ! in ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-208 src: none none 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt0: mod/noi/dif/loss/nce/logp -107.12/-1.69 /-105.43/0.69/-0.69 -5.95 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt1: mod/noi/dif/loss/nce/logp -107.12/-1.69 /-105.43/ /-0.69 -5.95 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt2: mod/noi/dif/loss/nce/logp -129.57/-13.57 /-116.01/ /-11.27 -7.20 /-0.75 19 [bos] confronted by a grim future , freddy lost fifty nerve and [unk] for a drastic liquidation . [eos] tgt3: mod/noi/dif/loss/nce/logp -143.94/-12.64 /-131.30/ /-26.56 -8.47 /-0.74 18 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation [eos] tgt4: mod/noi/dif/loss/nce/logp -132.62/-12.72 /-119.89/ /-15.16 -7.37 /-0.71 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for the drastic liquidation . [eos] tgt5: mod/noi/dif/loss/nce/logp -132.37/-12.71 /-119.66/ /-14.93 -7.35 /-0.71 19 [bos] confronted by the grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] cls0 - sp0 : -35.72 -1.98 19 0.00 [bos] she by a later society , cleaning made his cleaning and [unk] for a streets joined . [eos] cls0 - sp1 : -35.82 -1.99 19 0.00 [bos] she by a later cleaning , cleaning made his cleaning and [unk] for a streets joined . [eos] cls0 - sp2 : -35.89 -1.99 19 0.00 [bos] she by a later society , cleaning made his joined and [unk] for a streets joined . [eos] cls0 - sp3 : -35.91 -1.99 19 0.00 [bos] she by a most cleaning , cleaning made his cleaning and [unk] for a streets joined . [eos] cls0 - sp4 : -35.96 -2.00 19 0.00 [bos] she by a later society , cleaning made his patience and [unk] for a streets joined . [eos] cls1 - sp0 : -41.72 -2.32 19 0.28 [bos] she by a this telephone , cleaning made his telephone and [unk] for a streets joined . [eos] cls1 - sp1 : -41.98 -2.33 19 0.33 [bos] she by a this telephone , cleaning made his telephone and [unk] for a streets joined . [eos] cls1 - sp2 : -41.98 -2.33 19 0.28 [bos] she by a this telephone , cleaning space his telephone and [unk] for a streets joined . [eos] cls1 - sp3 : -42.01 -2.33 19 0.28 [bos] she by a this telephone , cleaning post his telephone and [unk] for a streets joined . [eos] cls1 - sp4 : -42.01 -2.33 19 0.28 [bos] she by a this telephone , cleaning made his telephone and [unk] for a couldn't joined . [eos] cls2 - sp0 : -44.92 -2.50 19 0.61 [bos] she by a this telephone , cleaning made his telephone and [unk] for a ! telephone . [eos] cls2 - sp1 : -44.96 -2.50 19 0.56 [bos] she by a this telephone , cleaning made his telephone and [unk] for a ! telephone . [eos] cls2 - sp2 : -45.12 -2.51 19 0.61 [bos] she by a this telephone , cleaning made his telephone and [unk] for a telephone telephone . [eos] cls2 - sp3 : -45.18 -2.51 19 0.61 [bos] she by a this telephone , cleaning post his telephone and [unk] for a ! telephone . [eos] cls2 - sp4 : -45.20 -2.51 19 0.61 [bos] she by a this telephone , cleaning space his telephone and [unk] for a ! telephone . [eos] cls3 - sp0 : -37.31 -2.07 19 1.00 [bos] she by a later state , telephone personal his telephone and [unk] for a corner telephone . [eos] cls3 - sp1 : -37.39 -2.08 19 1.00 [bos] she by a later crime , telephone personal his telephone and [unk] for a corner telephone . [eos] cls3 - sp2 : -37.42 -2.08 19 1.00 [bos] we by a later state , telephone personal his telephone and [unk] for a corner telephone . [eos] cls3 - sp3 : -37.42 -2.08 19 1.00 [bos] she by a later state , telephone personal his telephone and [unk] for a corner corner . [eos] cls3 - sp4 : -37.51 -2.08 19 1.00 [bos] she by a later crime , telephone personal his telephone and [unk] for a corner corner . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-209 src: none none 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt0: mod/noi/dif/loss/nce/logp -103.05/-1.69 /-101.36/0.69/-0.69 -5.72 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt1: mod/noi/dif/loss/nce/logp -103.05/-1.69 /-101.36/ /-0.69 -5.72 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt2: mod/noi/dif/loss/nce/logp -127.98/-13.57 /-114.42/ /-13.75 -7.11 /-0.75 19 [bos] confronted by a grim future , freddy lost fifty nerve and [unk] for a drastic liquidation . [eos] tgt3: mod/noi/dif/loss/nce/logp -142.37/-12.64 /-129.73/ /-29.07 -8.37 /-0.74 18 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation [eos] tgt4: mod/noi/dif/loss/nce/logp -128.63/-12.72 /-115.90/ /-15.24 -7.15 /-0.71 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for the drastic liquidation . [eos] tgt5: mod/noi/dif/loss/nce/logp -127.57/-12.71 /-114.86/ /-14.20 -7.09 /-0.71 19 [bos] confronted by the grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] cls0 - sp0 : -35.72 -1.98 19 0.00 [bos] she by a later society , cleaning made his cleaning and [unk] for a streets joined . [eos] cls0 - sp1 : -35.82 -1.99 19 0.00 [bos] she by a later cleaning , cleaning made his cleaning and [unk] for a streets joined . [eos] cls0 - sp2 : -35.89 -1.99 19 0.00 [bos] she by a later society , cleaning made his joined and [unk] for a streets joined . [eos] cls0 - sp3 : -35.91 -1.99 19 0.00 [bos] she by a most cleaning , cleaning made his cleaning and [unk] for a streets joined . [eos] cls0 - sp4 : -35.96 -2.00 19 0.00 [bos] she by a later society , cleaning made his patience and [unk] for a streets joined . [eos] cls1 - sp0 : -41.72 -2.32 19 0.28 [bos] she by a this telephone , cleaning made his telephone and [unk] for a streets joined . [eos] cls1 - sp1 : -41.98 -2.33 19 0.33 [bos] she by a this telephone , cleaning made his telephone and [unk] for a streets joined . [eos] cls1 - sp2 : -41.98 -2.33 19 0.28 [bos] she by a this telephone , cleaning space his telephone and [unk] for a streets joined . [eos] cls1 - sp3 : -42.01 -2.33 19 0.28 [bos] she by a this telephone , cleaning post his telephone and [unk] for a streets joined . [eos] cls1 - sp4 : -42.01 -2.33 19 0.28 [bos] she by a this telephone , cleaning made his telephone and [unk] for a couldn't joined . [eos] cls2 - sp0 : -44.92 -2.50 19 0.61 [bos] she by a this telephone , cleaning made his telephone and [unk] for a ! telephone . [eos] cls2 - sp1 : -44.96 -2.50 19 0.56 [bos] she by a this telephone , cleaning made his telephone and [unk] for a ! telephone . [eos] cls2 - sp2 : -45.12 -2.51 19 0.61 [bos] she by a this telephone , cleaning made his telephone and [unk] for a telephone telephone . [eos] cls2 - sp3 : -45.18 -2.51 19 0.61 [bos] she by a this telephone , cleaning post his telephone and [unk] for a ! telephone . [eos] cls2 - sp4 : -45.20 -2.51 19 0.61 [bos] she by a this telephone , cleaning space his telephone and [unk] for a ! telephone . [eos] cls3 - sp0 : -37.31 -2.07 19 1.00 [bos] she by a later state , telephone personal his telephone and [unk] for a corner telephone . [eos] cls3 - sp1 : -37.39 -2.08 19 1.00 [bos] she by a later crime , telephone personal his telephone and [unk] for a corner telephone . [eos] cls3 - sp2 : -37.42 -2.08 19 1.00 [bos] we by a later state , telephone personal his telephone and [unk] for a corner telephone . [eos] cls3 - sp3 : -37.42 -2.08 19 1.00 [bos] she by a later state , telephone personal his telephone and [unk] for a corner corner . [eos] cls3 - sp4 : -37.51 -2.08 19 1.00 [bos] she by a later crime , telephone personal his telephone and [unk] for a corner corner . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-210 src: none none 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt0: mod/noi/dif/loss/nce/logp -115.57/-1.69 /-113.87/0.69/-0.69 -6.42 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt1: mod/noi/dif/loss/nce/logp -115.57/-1.69 /-113.87/ /-0.69 -6.42 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt2: mod/noi/dif/loss/nce/logp -137.64/-13.57 /-124.07/ /-10.89 -7.65 /-0.75 19 [bos] confronted by a grim future , freddy lost fifty nerve and [unk] for a drastic liquidation . [eos] tgt3: mod/noi/dif/loss/nce/logp -151.97/-12.64 /-139.33/ /-26.15 -8.94 /-0.74 18 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation [eos] tgt4: mod/noi/dif/loss/nce/logp -141.30/-12.72 /-128.58/ /-15.40 -7.85 /-0.71 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for the drastic liquidation . [eos] tgt5: mod/noi/dif/loss/nce/logp -141.47/-12.71 /-128.76/ /-15.58 -7.86 /-0.71 19 [bos] confronted by the grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] cls0 - sp0 : -31.42 -1.75 19 0.00 [bos] she by a streets later , joined joined his are and [unk] for a ! cleaning . [eos] cls0 - sp1 : -31.43 -1.75 19 0.00 [bos] she by a streets later , joined joined his ! and [unk] for a ! cleaning . [eos] cls0 - sp2 : -31.58 -1.75 19 0.00 [bos] she by a streets later , joined couldn't his are and [unk] for a ! cleaning . [eos] cls0 - sp3 : -31.66 -1.76 19 0.00 [bos] she by a streets later , joined couldn't his ! and [unk] for a ! cleaning . [eos] cls0 - sp4 : -31.66 -1.76 19 0.00 [bos] she by a streets later , joined streets his ! and [unk] for a ! cleaning . [eos] cls1 - sp0 : -35.54 -1.97 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! bidding . [eos] cls1 - sp1 : -35.55 -1.97 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! cleaning . [eos] cls1 - sp2 : -35.79 -1.99 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! skies . [eos] cls1 - sp3 : -39.87 -2.21 19 0.44 [bos] she by a personal later , personal couldn't his but and [unk] for a ! bidding . [eos] cls1 - sp4 : -40.16 -2.23 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! cleaning . [eos] cls2 - sp0 : -39.70 -2.21 19 0.50 [bos] she by a personal later , personal couldn't his but and [unk] for a ! bidding . [eos] cls2 - sp1 : -39.87 -2.22 19 0.50 [bos] she by a personal later , personal laughed his but and [unk] for a ! bidding . [eos] cls2 - sp2 : -39.99 -2.22 19 0.50 [bos] she by a later later , personal couldn't his but and [unk] for a ! bidding . [eos] cls2 - sp3 : -40.12 -2.23 19 0.50 [bos] she by a personal later , telephone laughed his but and [unk] for a ! bidding . [eos] cls2 - sp4 : -40.22 -2.23 19 0.50 [bos] she by a personal later , personal couldn't his but and [unk] for a ! cleaning . [eos] cls3 - sp0 : -30.03 -1.67 19 1.00 [bos] she by a corner later , personal personal his but and [unk] for a ! telephone . [eos] cls3 - sp1 : -30.09 -1.67 19 1.00 [bos] she by a corner later , personal corner his but and [unk] for a ! telephone . [eos] cls3 - sp2 : -30.34 -1.69 19 1.00 [bos] she by a corner later , personal rome his but and [unk] for a ! telephone . [eos] cls3 - sp3 : -30.34 -1.69 19 1.00 [bos] she by a corner later , personal telephone his but and [unk] for a ! telephone . [eos] cls3 - sp4 : -30.50 -1.69 19 1.00 [bos] she by a corner later , corner corner his but and [unk] for a ! telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-211 src: none none 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt0: mod/noi/dif/loss/nce/logp -109.26/-1.69 /-107.57/0.69/-0.69 -6.07 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt1: mod/noi/dif/loss/nce/logp -109.26/-1.69 /-107.57/ /-0.69 -6.07 /-0.09 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] tgt2: mod/noi/dif/loss/nce/logp -133.79/-13.57 /-120.22/ /-13.35 -7.43 /-0.75 19 [bos] confronted by a grim future , freddy lost fifty nerve and [unk] for a drastic liquidation . [eos] tgt3: mod/noi/dif/loss/nce/logp -147.63/-12.64 /-134.98/ /-28.11 -8.68 /-0.74 18 [bos] confronted by a grim future , freddy lost his nerve and [unk] for a drastic liquidation [eos] tgt4: mod/noi/dif/loss/nce/logp -134.95/-12.72 /-122.23/ /-15.35 -7.50 /-0.71 19 [bos] confronted by a grim future , freddy lost his nerve and [unk] for the drastic liquidation . [eos] tgt5: mod/noi/dif/loss/nce/logp -134.39/-12.71 /-121.68/ /-14.80 -7.47 /-0.71 19 [bos] confronted by the grim future , freddy lost his nerve and [unk] for a drastic liquidation . [eos] cls0 - sp0 : -31.42 -1.75 19 0.00 [bos] she by a streets later , joined joined his are and [unk] for a ! cleaning . [eos] cls0 - sp1 : -31.43 -1.75 19 0.00 [bos] she by a streets later , joined joined his ! and [unk] for a ! cleaning . [eos] cls0 - sp2 : -31.58 -1.75 19 0.00 [bos] she by a streets later , joined couldn't his are and [unk] for a ! cleaning . [eos] cls0 - sp3 : -31.66 -1.76 19 0.00 [bos] she by a streets later , joined couldn't his ! and [unk] for a ! cleaning . [eos] cls0 - sp4 : -31.66 -1.76 19 0.00 [bos] she by a streets later , joined streets his ! and [unk] for a ! cleaning . [eos] cls1 - sp0 : -35.54 -1.97 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! bidding . [eos] cls1 - sp1 : -35.55 -1.97 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! cleaning . [eos] cls1 - sp2 : -35.79 -1.99 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! skies . [eos] cls1 - sp3 : -39.87 -2.21 19 0.44 [bos] she by a personal later , personal couldn't his but and [unk] for a ! bidding . [eos] cls1 - sp4 : -40.16 -2.23 19 0.28 [bos] all by a 7 later , joined joined his ! and [unk] for a ! cleaning . [eos] cls2 - sp0 : -39.70 -2.21 19 0.50 [bos] she by a personal later , personal couldn't his but and [unk] for a ! bidding . [eos] cls2 - sp1 : -39.87 -2.22 19 0.50 [bos] she by a personal later , personal laughed his but and [unk] for a ! bidding . [eos] cls2 - sp2 : -39.99 -2.22 19 0.50 [bos] she by a later later , personal couldn't his but and [unk] for a ! bidding . [eos] cls2 - sp3 : -40.12 -2.23 19 0.50 [bos] she by a personal later , telephone laughed his but and [unk] for a ! bidding . [eos] cls2 - sp4 : -40.22 -2.23 19 0.50 [bos] she by a personal later , personal couldn't his but and [unk] for a ! cleaning . [eos] cls3 - sp0 : -30.03 -1.67 19 1.00 [bos] she by a corner later , personal personal his but and [unk] for a ! telephone . [eos] cls3 - sp1 : -30.09 -1.67 19 1.00 [bos] she by a corner later , personal corner his but and [unk] for a ! telephone . [eos] cls3 - sp2 : -30.34 -1.69 19 1.00 [bos] she by a corner later , personal rome his but and [unk] for a ! telephone . [eos] cls3 - sp3 : -30.34 -1.69 19 1.00 [bos] she by a corner later , personal telephone his but and [unk] for a ! telephone . [eos] cls3 - sp4 : -30.50 -1.69 19 1.00 [bos] she by a corner later , corner corner his but and [unk] for a ! telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-212 src: none none 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt0: mod/noi/dif/loss/nce/logp -217.89/-4.16 /-213.72/0.69/-0.69 -5.19 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt1: mod/noi/dif/loss/nce/logp -217.89/-4.16 /-213.72/ /-0.69 -5.19 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt2: mod/noi/dif/loss/nce/logp -355.22/-12.28 /-342.94/ /-129.91 -39.47/-1.36 10 [bos] ticonderoga folded a few minutes too soon . [eos] tgt3: mod/noi/dif/loss/nce/logp -383.41/-12.73 /-370.69/ /-157.66 -27.39/-0.91 15 [bos] ticonderoga folded a few minutes too soon , before the tide changed . [eos] tgt4: mod/noi/dif/loss/nce/logp -241.00/-15.10 /-225.91/ /-12.88 -5.74 /-0.36 43 [bos] ticonderoga folded the few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt5: mod/noi/dif/loss/nce/logp -259.15/-15.17 /-243.98/ /-30.95 -6.32 /-0.37 42 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made [eos] cls0 - sp0 : -87.95 -2.09 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the first had is were united to be , -- one -- society for any , . is [eos] cls0 - sp1 : -88.01 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the first had is were united to be , -- one -- united for any , . is [eos] cls0 - sp2 : -88.08 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the first had is were united to be , -- one -- society for than , . is [eos] cls0 - sp3 : -88.09 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the would had is were united to be , -- one -- society for any , . is [eos] cls0 - sp4 : -88.12 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the would had is were united to be , -- one -- united for any , . is [eos] cls1 - sp0 : -113.97 -2.71 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- society for than , . is [eos] cls1 - sp1 : -113.99 -2.71 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- united for than , . is [eos] cls1 - sp2 : -114.03 -2.71 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- preceding for than , . is [eos] cls1 - sp3 : -114.13 -2.72 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- governor's for than , . is [eos] cls1 - sp4 : -119.13 -2.84 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- society for than , preceding . [eos] cls2 - sp0 : -128.74 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime oilcloth , made crime and crime -- and the life of it that first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp1 : -128.78 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime strode , made crime and crime -- and the life of it that first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp2 : -128.82 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime oilcloth , made crime and crime -- and the life of it the first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp3 : -128.83 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime strode , made crime and crime -- and the discussed of it that first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp4 : -128.85 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime strode , made crime and crime -- and the life of it the first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls3 - sp0 : -99.99 -2.38 43 1.00 [bos] '' personal a were group our did , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- -- -- state for life , crime . [eos] cls3 - sp1 : -100.06 -2.38 43 1.00 [bos] '' personal a were group our did , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- much -- state for life , crime . [eos] cls3 - sp2 : -100.08 -2.38 43 1.00 [bos] '' personal a were a later almost , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- -- -- state for life , crime . [eos] cls3 - sp3 : -100.10 -2.38 43 1.00 [bos] '' personal a were a later almost , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- much -- state for life , crime . [eos] cls3 - sp4 : -100.10 -2.38 43 1.00 [bos] '' personal a were group our did , much the crime streets , made personal and crime -- and the 1961 of it the first had is other new to be year -- -- -- state for life , crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-213 src: none none 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt0: mod/noi/dif/loss/nce/logp -214.39/-4.16 /-210.23/0.69/-0.69 -5.10 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt1: mod/noi/dif/loss/nce/logp -214.39/-4.16 /-210.23/ /-0.69 -5.10 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt2: mod/noi/dif/loss/nce/logp -352.31/-12.28 /-340.02/ /-130.49 -39.15/-1.36 10 [bos] ticonderoga folded a few minutes too soon . [eos] tgt3: mod/noi/dif/loss/nce/logp -378.11/-12.73 /-365.39/ /-155.85 -27.01/-0.91 15 [bos] ticonderoga folded a few minutes too soon , before the tide changed . [eos] tgt4: mod/noi/dif/loss/nce/logp -237.66/-15.10 /-222.56/ /-13.03 -5.66 /-0.36 43 [bos] ticonderoga folded the few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt5: mod/noi/dif/loss/nce/logp -258.85/-15.17 /-243.67/ /-34.14 -6.31 /-0.37 42 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made [eos] cls0 - sp0 : -87.95 -2.09 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the first had is were united to be , -- one -- society for any , . is [eos] cls0 - sp1 : -88.01 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the first had is were united to be , -- one -- united for any , . is [eos] cls0 - sp2 : -88.08 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the first had is were united to be , -- one -- society for than , . is [eos] cls0 - sp3 : -88.09 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the would had is were united to be , -- one -- society for any , . is [eos] cls0 - sp4 : -88.12 -2.10 43 0.02 [bos] : watching a its world later it , much the preceding part , made preceding and preceding -- and the preceding of it the would had is were united to be , -- one -- united for any , . is [eos] cls1 - sp0 : -113.97 -2.71 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- society for than , . is [eos] cls1 - sp1 : -113.99 -2.71 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- united for than , . is [eos] cls1 - sp2 : -114.03 -2.71 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- preceding for than , . is [eos] cls1 - sp3 : -114.13 -2.72 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- governor's for than , . is [eos] cls1 - sp4 : -119.13 -2.84 43 0.26 [bos] '' personal a its were they it , when the preceding sunset , made preceding and sunset -- and the creatures of it the she had is were nick to be , -- one -- society for than , preceding . [eos] cls2 - sp0 : -128.74 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime oilcloth , made crime and crime -- and the life of it that first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp1 : -128.78 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime strode , made crime and crime -- and the life of it that first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp2 : -128.82 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime oilcloth , made crime and crime -- and the life of it the first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp3 : -128.83 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime strode , made crime and crime -- and the discussed of it that first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls2 - sp4 : -128.85 -3.07 43 0.74 [bos] '' personal a its world later did , much the crime strode , made crime and crime -- and the life of it the first had is were new to be gloomy who were -- gloomy for life , gloomy . [eos] cls3 - sp0 : -99.99 -2.38 43 1.00 [bos] '' personal a were group our did , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- -- -- state for life , crime . [eos] cls3 - sp1 : -100.06 -2.38 43 1.00 [bos] '' personal a were group our did , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- much -- state for life , crime . [eos] cls3 - sp2 : -100.08 -2.38 43 1.00 [bos] '' personal a were a later almost , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- -- -- state for life , crime . [eos] cls3 - sp3 : -100.10 -2.38 43 1.00 [bos] '' personal a were a later almost , much the crime streets , made streets and crime -- and the 1961 of it the first had is other new to be year -- much -- state for life , crime . [eos] cls3 - sp4 : -100.10 -2.38 43 1.00 [bos] '' personal a were group our did , much the crime streets , made personal and crime -- and the 1961 of it the first had is other new to be year -- -- -- state for life , crime . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-214 src: none none 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt0: mod/noi/dif/loss/nce/logp -224.18/-4.16 /-220.01/0.69/-0.69 -5.34 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt1: mod/noi/dif/loss/nce/logp -224.18/-4.16 /-220.01/ /-0.69 -5.34 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt2: mod/noi/dif/loss/nce/logp -359.77/-12.28 /-347.49/ /-128.17 -39.97/-1.36 10 [bos] ticonderoga folded a few minutes too soon . [eos] tgt3: mod/noi/dif/loss/nce/logp -388.57/-12.73 /-375.84/ /-156.52 -27.75/-0.91 15 [bos] ticonderoga folded a few minutes too soon , before the tide changed . [eos] tgt4: mod/noi/dif/loss/nce/logp -248.27/-15.10 /-233.17/ /-13.85 -5.91 /-0.36 43 [bos] ticonderoga folded the few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt5: mod/noi/dif/loss/nce/logp -263.73/-15.17 /-248.56/ /-29.24 -6.43 /-0.37 42 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made [eos] cls0 - sp0 : -85.81 -2.04 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ) the would had is . is to be society -- one -- joined for within , states . [eos] cls0 - sp1 : -85.86 -2.04 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ) the would had is . is to be streets -- one -- joined for within , states . [eos] cls0 - sp2 : -85.88 -2.04 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ) the would had is . is to be society -- one -- joined for states , states . [eos] cls0 - sp3 : -85.90 -2.05 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ( the would had is . is to be society -- one -- joined for within , states . [eos] cls0 - sp4 : -85.91 -2.05 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ( the would had is . is to be society -- one -- joined for states , states . [eos] cls1 - sp0 : -112.86 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into 7 to be governor's -- one -- . is years , rome . [eos] cls1 - sp1 : -112.97 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the creatures of ( the she had is into 7 to be governor's -- one -- . is years , rome . [eos] cls1 - sp2 : -112.98 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into don't to be governor's -- one -- . is years , rome . [eos] cls1 - sp3 : -113.00 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into 7 to be governor's -- one -- . is years , states . [eos] cls1 - sp4 : -113.03 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into 7 to be governor's -- one -- . is within , rome . [eos] cls2 - sp0 : -127.53 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , more streets and people -- and the crime of ( the all had which into personal to be gloomy -- `` -- gloomy for number , gloomy . [eos] cls2 - sp1 : -127.63 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , can streets and people -- and the crime of ( the all had which into personal to be gloomy but `` -- gloomy for number , gloomy . [eos] cls2 - sp2 : -127.64 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , more streets and people -- and the crime of ( the all had which into personal to be gloomy but `` -- gloomy for number , gloomy . [eos] cls2 - sp3 : -127.67 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , can streets and people -- and the crime of ( the all had which into personal to be gloomy -- `` -- gloomy for number , gloomy . [eos] cls2 - sp4 : -127.71 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , more streets and people -- and the crime of ( the all had which into personal to be gloomy -- and -- gloomy for number , gloomy . [eos] cls3 - sp0 : -102.99 -2.45 43 1.00 [bos] '' were a a were later streets , before the state example , him streets and people -- and the crime of ( the all had is our new to be example -- new -- center for number , streets . [eos] cls3 - sp1 : -103.01 -2.45 43 1.00 [bos] '' were a a were later streets , before the state example , him streets and people -- and the crime of ( the all had is through new to be example -- new -- center for number , streets . [eos] cls3 - sp2 : -103.03 -2.45 43 1.00 [bos] '' were a a were later streets , before the state example , him crime and people -- and the crime of ( the all had is through new to be example -- new -- center for number , streets . [eos] cls3 - sp3 : -103.03 -2.45 43 1.00 [bos] '' were a a were later streets , before the crime example , him streets and people -- and the crime of ( the all had is our new to be example -- new -- center for number , streets . [eos] cls3 - sp4 : -103.04 -2.45 43 1.00 [bos] '' were a a were later streets , before the state people , him streets and people -- and the crime of ( the all had is our new to be example -- new -- center for number , streets . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-215 src: none none 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt0: mod/noi/dif/loss/nce/logp -217.92/-4.16 /-213.75/0.69/-0.69 -5.19 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt1: mod/noi/dif/loss/nce/logp -217.92/-4.16 /-213.75/ /-0.69 -5.19 /-0.10 43 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt2: mod/noi/dif/loss/nce/logp -356.32/-12.28 /-344.03/ /-130.97 -39.59/-1.36 10 [bos] ticonderoga folded a few minutes too soon . [eos] tgt3: mod/noi/dif/loss/nce/logp -381.72/-12.73 /-369.00/ /-155.94 -27.27/-0.91 15 [bos] ticonderoga folded a few minutes too soon , before the tide changed . [eos] tgt4: mod/noi/dif/loss/nce/logp -241.90/-15.10 /-226.80/ /-13.74 -5.76 /-0.36 43 [bos] ticonderoga folded the few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made . [eos] tgt5: mod/noi/dif/loss/nce/logp -261.04/-15.17 /-245.86/ /-32.80 -6.37 /-0.37 42 [bos] ticonderoga folded a few minutes too soon , before the tide changed , still honest and stupid -- and the network of dealers the company had is around waiting to be signed up again -- waiting for us , ready-made [eos] cls0 - sp0 : -85.81 -2.04 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ) the would had is . is to be society -- one -- joined for within , states . [eos] cls0 - sp1 : -85.86 -2.04 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ) the would had is . is to be streets -- one -- joined for within , states . [eos] cls0 - sp2 : -85.88 -2.04 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ) the would had is . is to be society -- one -- joined for states , states . [eos] cls0 - sp3 : -85.90 -2.05 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ( the would had is . is to be society -- one -- joined for within , states . [eos] cls0 - sp4 : -85.91 -2.05 43 0.02 [bos] '' were a its were later streets , but the preceding preceding , more preceding and society -- and the preceding of ( the would had is . is to be society -- one -- joined for states , states . [eos] cls1 - sp0 : -112.86 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into 7 to be governor's -- one -- . is years , rome . [eos] cls1 - sp1 : -112.97 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the creatures of ( the she had is into 7 to be governor's -- one -- . is years , rome . [eos] cls1 - sp2 : -112.98 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into don't to be governor's -- one -- . is years , rome . [eos] cls1 - sp3 : -113.00 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into 7 to be governor's -- one -- . is years , states . [eos] cls1 - sp4 : -113.03 -2.69 43 0.26 [bos] '' rather a its were later streets , were the preceding preceding , more [unk] and society -- and the lolotte of ( the she had is into 7 to be governor's -- one -- . is within , rome . [eos] cls2 - sp0 : -127.53 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , more streets and people -- and the crime of ( the all had which into personal to be gloomy -- `` -- gloomy for number , gloomy . [eos] cls2 - sp1 : -127.63 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , can streets and people -- and the crime of ( the all had which into personal to be gloomy but `` -- gloomy for number , gloomy . [eos] cls2 - sp2 : -127.64 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , more streets and people -- and the crime of ( the all had which into personal to be gloomy but `` -- gloomy for number , gloomy . [eos] cls2 - sp3 : -127.67 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , can streets and people -- and the crime of ( the all had which into personal to be gloomy -- `` -- gloomy for number , gloomy . [eos] cls2 - sp4 : -127.71 -3.04 43 0.74 [bos] '' years a its were later did , but the crime telephone , more streets and people -- and the crime of ( the all had which into personal to be gloomy -- and -- gloomy for number , gloomy . [eos] cls3 - sp0 : -102.99 -2.45 43 1.00 [bos] '' were a a were later streets , before the state example , him streets and people -- and the crime of ( the all had is our new to be example -- new -- center for number , streets . [eos] cls3 - sp1 : -103.01 -2.45 43 1.00 [bos] '' were a a were later streets , before the state example , him streets and people -- and the crime of ( the all had is through new to be example -- new -- center for number , streets . [eos] cls3 - sp2 : -103.03 -2.45 43 1.00 [bos] '' were a a were later streets , before the state example , him crime and people -- and the crime of ( the all had is through new to be example -- new -- center for number , streets . [eos] cls3 - sp3 : -103.03 -2.45 43 1.00 [bos] '' were a a were later streets , before the crime example , him streets and people -- and the crime of ( the all had is our new to be example -- new -- center for number , streets . [eos] cls3 - sp4 : -103.04 -2.45 43 1.00 [bos] '' were a a were later streets , before the state people , him streets and people -- and the crime of ( the all had is our new to be example -- new -- center for number , streets . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-216 src: none none 10 [bos] `` all right '' , william said . [eos] tgt0: mod/noi/dif/loss/nce/logp -32.38 /-1.07 /-31.31 /0.69/-0.69 -3.60 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt1: mod/noi/dif/loss/nce/logp -32.38 /-1.07 /-31.31 / /-0.69 -3.60 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt2: mod/noi/dif/loss/nce/logp -60.33 /-11.97 /-48.36 / /-17.74 -7.54 /-1.50 9 [bos] `` all right '' , william said [eos] tgt3: mod/noi/dif/loss/nce/logp -140.51/-11.99 /-128.53/ /-97.91 -35.13/-3.00 5 [bos] `` all right [eos] tgt4: mod/noi/dif/loss/nce/logp -133.62/-12.20 /-121.42/ /-90.81 -22.27/-2.03 7 [bos] `` all right '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -70.84 /-12.24 /-58.60 / /-27.99 -7.08 /-1.22 11 [bos] `` all right '' , william said . . [eos] cls0 - sp0 : -12.26 -1.36 10 0.11 [bos] ! ! ! '' , ! ! . [eos] cls0 - sp1 : -12.31 -1.37 10 0.11 [bos] ! ! ! '' , ! had . [eos] cls0 - sp2 : -12.43 -1.38 10 0.11 [bos] ! ! ! '' , no had . [eos] cls0 - sp3 : -12.52 -1.39 10 0.11 [bos] ! ! ! '' , later had . [eos] cls0 - sp4 : -12.62 -1.40 10 0.00 [bos] she all ! '' , later had . [eos] cls1 - sp0 : -11.63 -1.29 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp1 : -11.69 -1.30 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp2 : -11.69 -1.30 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls1 - sp3 : -11.75 -1.31 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp4 : -11.80 -1.31 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls2 - sp0 : -11.23 -1.25 10 0.56 [bos] ! ! ! '' , ! ! . [eos] cls2 - sp1 : -11.25 -1.25 10 0.56 [bos] ! ! ! '' , ! had . [eos] cls2 - sp2 : -11.75 -1.31 10 0.67 [bos] ! ! ! '' , later had . [eos] cls2 - sp3 : -11.80 -1.31 10 0.56 [bos] ! ! ! '' , ! -- . [eos] cls2 - sp4 : -12.13 -1.35 10 0.67 [bos] ! ! ! '' , ! ! . [eos] cls3 - sp0 : -11.91 -1.32 10 0.89 [bos] ! ! ! '' , later ! . [eos] cls3 - sp1 : -11.98 -1.33 10 0.89 [bos] ! ! ! '' , later had . [eos] cls3 - sp2 : -11.99 -1.33 10 0.89 [bos] ! ! ! '' , ! ! ! [eos] cls3 - sp3 : -12.07 -1.34 10 0.89 [bos] ! ! ! '' , don't had . [eos] cls3 - sp4 : -12.27 -1.36 10 0.78 [bos] ! ! ! '' , ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-217 src: none none 10 [bos] `` all right '' , william said . [eos] tgt0: mod/noi/dif/loss/nce/logp -35.69 /-1.07 /-34.62 /0.69/-0.69 -3.97 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt1: mod/noi/dif/loss/nce/logp -35.69 /-1.07 /-34.62 / /-0.69 -3.97 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt2: mod/noi/dif/loss/nce/logp -66.56 /-11.97 /-54.58 / /-20.66 -8.32 /-1.50 9 [bos] `` all right '' , william said [eos] tgt3: mod/noi/dif/loss/nce/logp -137.19/-11.99 /-125.20/ /-91.28 -34.30/-3.00 5 [bos] `` all right [eos] tgt4: mod/noi/dif/loss/nce/logp -127.66/-12.20 /-115.46/ /-81.53 -21.28/-2.03 7 [bos] `` all right '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -74.20 /-12.24 /-61.96 / /-28.04 -7.42 /-1.22 11 [bos] `` all right '' , william said . . [eos] cls0 - sp0 : -12.26 -1.36 10 0.11 [bos] ! ! ! '' , ! ! . [eos] cls0 - sp1 : -12.31 -1.37 10 0.11 [bos] ! ! ! '' , ! had . [eos] cls0 - sp2 : -12.43 -1.38 10 0.11 [bos] ! ! ! '' , no had . [eos] cls0 - sp3 : -12.52 -1.39 10 0.11 [bos] ! ! ! '' , later had . [eos] cls0 - sp4 : -12.62 -1.40 10 0.00 [bos] she all ! '' , later had . [eos] cls1 - sp0 : -11.63 -1.29 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp1 : -11.69 -1.30 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp2 : -11.69 -1.30 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls1 - sp3 : -11.75 -1.31 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp4 : -11.80 -1.31 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls2 - sp0 : -11.23 -1.25 10 0.56 [bos] ! ! ! '' , ! ! . [eos] cls2 - sp1 : -11.25 -1.25 10 0.56 [bos] ! ! ! '' , ! had . [eos] cls2 - sp2 : -11.75 -1.31 10 0.67 [bos] ! ! ! '' , later had . [eos] cls2 - sp3 : -11.80 -1.31 10 0.56 [bos] ! ! ! '' , ! -- . [eos] cls2 - sp4 : -12.13 -1.35 10 0.67 [bos] ! ! ! '' , ! ! . [eos] cls3 - sp0 : -11.91 -1.32 10 0.89 [bos] ! ! ! '' , later ! . [eos] cls3 - sp1 : -11.98 -1.33 10 0.89 [bos] ! ! ! '' , later had . [eos] cls3 - sp2 : -11.99 -1.33 10 0.89 [bos] ! ! ! '' , ! ! ! [eos] cls3 - sp3 : -12.07 -1.34 10 0.89 [bos] ! ! ! '' , don't had . [eos] cls3 - sp4 : -12.27 -1.36 10 0.78 [bos] ! ! ! '' , ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-218 src: none none 10 [bos] `` all right '' , william said . [eos] tgt0: mod/noi/dif/loss/nce/logp -32.58 /-1.07 /-31.51 /0.69/-0.69 -3.62 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt1: mod/noi/dif/loss/nce/logp -32.58 /-1.07 /-31.51 / /-0.69 -3.62 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt2: mod/noi/dif/loss/nce/logp -61.82 /-11.97 /-49.85 / /-19.03 -7.73 /-1.50 9 [bos] `` all right '' , william said [eos] tgt3: mod/noi/dif/loss/nce/logp -132.06/-11.99 /-120.07/ /-89.26 -33.02/-3.00 5 [bos] `` all right [eos] tgt4: mod/noi/dif/loss/nce/logp -112.44/-12.20 /-100.24/ /-69.43 -18.74/-2.03 7 [bos] `` all right '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -69.59 /-12.24 /-57.36 / /-26.54 -6.96 /-1.22 11 [bos] `` all right '' , william said . . [eos] cls0 - sp0 : -12.15 -1.35 10 0.22 [bos] ! ! ! '' , ! had . [eos] cls0 - sp1 : -12.49 -1.39 10 0.11 [bos] ! ! ! '' , ! had . [eos] cls0 - sp2 : -12.52 -1.39 10 0.22 [bos] ! ! ! '' , ! ! . [eos] cls0 - sp3 : -12.79 -1.42 10 0.11 [bos] ! ! ! '' , ! or . [eos] cls0 - sp4 : -12.84 -1.43 10 0.11 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp0 : -11.66 -1.30 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls1 - sp1 : -11.70 -1.30 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls1 - sp2 : -11.85 -1.32 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp3 : -11.96 -1.33 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp4 : -12.02 -1.34 10 0.33 [bos] ! ! ! '' , ! had . [eos] cls2 - sp0 : -11.02 -1.22 10 0.67 [bos] ! ! ! '' , ! had . [eos] cls2 - sp1 : -11.17 -1.24 10 0.56 [bos] ! ! ! '' , ! had . [eos] cls2 - sp2 : -11.37 -1.26 10 0.56 [bos] ! ! ! '' , ! ! . [eos] cls2 - sp3 : -11.40 -1.27 10 0.67 [bos] ! ! ! '' , ! -- . [eos] cls2 - sp4 : -11.41 -1.27 10 0.67 [bos] ! ! ! '' , ! ! . [eos] cls3 - sp0 : -11.20 -1.24 10 0.89 [bos] ! ! ! '' , ! out . [eos] cls3 - sp1 : -11.21 -1.25 10 0.89 [bos] ! ! ! '' , ! had . [eos] cls3 - sp2 : -11.39 -1.27 10 0.89 [bos] ! ! ! '' , ! at . [eos] cls3 - sp3 : -11.47 -1.27 10 0.78 [bos] ! ! ! '' , ! ! . [eos] cls3 - sp4 : -11.50 -1.28 10 0.89 [bos] ! ! ! '' , ! between . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-219 src: none none 10 [bos] `` all right '' , william said . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.64 /-1.07 /-33.56 /0.69/-0.69 -3.85 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.64 /-1.07 /-33.56 / /-0.69 -3.85 /-0.12 10 [bos] `` all right '' , william said . [eos] tgt2: mod/noi/dif/loss/nce/logp -67.72 /-11.97 /-55.75 / /-22.88 -8.46 /-1.50 9 [bos] `` all right '' , william said [eos] tgt3: mod/noi/dif/loss/nce/logp -128.30/-11.99 /-116.31/ /-83.44 -32.07/-3.00 5 [bos] `` all right [eos] tgt4: mod/noi/dif/loss/nce/logp -110.36/-12.20 /-98.16 / /-65.28 -18.39/-2.03 7 [bos] `` all right '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -72.23 /-12.24 /-59.99 / /-27.12 -7.22 /-1.22 11 [bos] `` all right '' , william said . . [eos] cls0 - sp0 : -12.15 -1.35 10 0.22 [bos] ! ! ! '' , ! had . [eos] cls0 - sp1 : -12.49 -1.39 10 0.11 [bos] ! ! ! '' , ! had . [eos] cls0 - sp2 : -12.52 -1.39 10 0.22 [bos] ! ! ! '' , ! ! . [eos] cls0 - sp3 : -12.79 -1.42 10 0.11 [bos] ! ! ! '' , ! or . [eos] cls0 - sp4 : -12.84 -1.43 10 0.11 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp0 : -11.66 -1.30 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls1 - sp1 : -11.70 -1.30 10 0.44 [bos] ! ! ! '' , ! had . [eos] cls1 - sp2 : -11.85 -1.32 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp3 : -11.96 -1.33 10 0.44 [bos] ! ! ! '' , ! ! . [eos] cls1 - sp4 : -12.02 -1.34 10 0.33 [bos] ! ! ! '' , ! had . [eos] cls2 - sp0 : -11.02 -1.22 10 0.67 [bos] ! ! ! '' , ! had . [eos] cls2 - sp1 : -11.17 -1.24 10 0.56 [bos] ! ! ! '' , ! had . [eos] cls2 - sp2 : -11.37 -1.26 10 0.56 [bos] ! ! ! '' , ! ! . [eos] cls2 - sp3 : -11.40 -1.27 10 0.67 [bos] ! ! ! '' , ! -- . [eos] cls2 - sp4 : -11.41 -1.27 10 0.67 [bos] ! ! ! '' , ! ! . [eos] cls3 - sp0 : -11.20 -1.24 10 0.89 [bos] ! ! ! '' , ! out . [eos] cls3 - sp1 : -11.21 -1.25 10 0.89 [bos] ! ! ! '' , ! had . [eos] cls3 - sp2 : -11.39 -1.27 10 0.89 [bos] ! ! ! '' , ! at . [eos] cls3 - sp3 : -11.47 -1.27 10 0.78 [bos] ! ! ! '' , ! ! . [eos] cls3 - sp4 : -11.50 -1.28 10 0.89 [bos] ! ! ! '' , ! between . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-220 src: none none 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt0: mod/noi/dif/loss/nce/logp -91.77 /-2.82 /-88.96 /0.69/-0.69 -3.67 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt1: mod/noi/dif/loss/nce/logp -91.77 /-2.82 /-88.96 / /-0.69 -3.67 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt2: mod/noi/dif/loss/nce/logp -205.35/-12.76 /-192.59/ /-104.33 -18.67/-1.16 12 [bos] `` all the [unk] have got to have their day [eos] tgt3: mod/noi/dif/loss/nce/logp -287.87/-13.06 /-274.81/ /-186.55 -22.14/-1.00 14 [bos] `` all the [unk] have got to have their day '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -295.13/-13.32 /-281.81/ /-193.55 -18.45/-0.83 17 [bos] `` all the [unk] have got to have their day '' , adam said . [eos] tgt5: mod/noi/dif/loss/nce/logp -271.55/-12.93 /-258.62/ /-170.36 -33.94/-1.62 9 [bos] `` all the [unk] have got . [eos] cls0 - sp0 : -44.27 -1.77 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and joined at rome and cleaning in any . [eos] cls0 - sp1 : -44.36 -1.77 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and streets at rome and cleaning in any . [eos] cls0 - sp2 : -44.38 -1.78 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and organized at rome and cleaning in any . [eos] cls0 - sp3 : -44.46 -1.78 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and joined at rome and patience in any . [eos] cls0 - sp4 : -44.50 -1.78 26 0.00 [bos] : all the [unk] have streets to have their joined '' , streets had , and joined at rome and cleaning in any . [eos] cls1 - sp0 : -53.17 -2.13 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and cleaning at rome and discussed in any . [eos] cls1 - sp1 : -53.24 -2.13 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and organized at rome and discussed in any . [eos] cls1 - sp2 : -53.39 -2.14 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and editor at rome and discussed in any . [eos] cls1 - sp3 : -53.42 -2.14 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and cleaning at general and discussed in any . [eos] cls1 - sp4 : -53.44 -2.14 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and organized at general and discussed in any . [eos] cls2 - sp0 : -51.41 -2.06 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and indifferent in no . [eos] cls2 - sp1 : -51.57 -2.06 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and discussed in no . [eos] cls2 - sp2 : -51.62 -2.06 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and mississippi in no . [eos] cls2 - sp3 : -51.63 -2.07 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and telephone in no . [eos] cls2 - sp4 : -51.65 -2.07 26 0.64 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and discussed in any . [eos] cls3 - sp0 : -44.50 -1.78 26 1.00 [bos] she all the [unk] have state to have their telephone '' , telephone only , and telephone at state and crime in be . [eos] cls3 - sp1 : -44.52 -1.78 26 1.00 [bos] she all the [unk] have state to have their telephone '' , housing only , and telephone at state and crime in be . [eos] cls3 - sp2 : -44.62 -1.78 26 1.00 [bos] she all the [unk] have state to have their corner '' , telephone only , and telephone at state and crime in be . [eos] cls3 - sp3 : -44.65 -1.79 26 1.00 [bos] she all the [unk] have state to have their corner '' , housing only , and telephone at state and crime in be . [eos] cls3 - sp4 : -44.66 -1.79 26 1.00 [bos] she all the [unk] have state to have their telephone '' , telephone only , and telephone at state and mississippi in be . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-221 src: none none 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt0: mod/noi/dif/loss/nce/logp -90.79 /-2.82 /-87.97 /0.69/-0.69 -3.63 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt1: mod/noi/dif/loss/nce/logp -90.79 /-2.82 /-87.97 / /-0.69 -3.63 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt2: mod/noi/dif/loss/nce/logp -189.84/-12.76 /-177.08/ /-89.80 -17.26/-1.16 12 [bos] `` all the [unk] have got to have their day [eos] tgt3: mod/noi/dif/loss/nce/logp -276.54/-13.06 /-263.48/ /-176.21 -21.27/-1.00 14 [bos] `` all the [unk] have got to have their day '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -279.90/-13.32 /-266.59/ /-179.31 -17.49/-0.83 17 [bos] `` all the [unk] have got to have their day '' , adam said . [eos] tgt5: mod/noi/dif/loss/nce/logp -268.84/-12.93 /-255.91/ /-168.63 -33.60/-1.62 9 [bos] `` all the [unk] have got . [eos] cls0 - sp0 : -44.27 -1.77 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and joined at rome and cleaning in any . [eos] cls0 - sp1 : -44.36 -1.77 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and streets at rome and cleaning in any . [eos] cls0 - sp2 : -44.38 -1.78 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and organized at rome and cleaning in any . [eos] cls0 - sp3 : -44.46 -1.78 26 0.00 [bos] : all the [unk] have united to have their joined '' , streets had , and joined at rome and patience in any . [eos] cls0 - sp4 : -44.50 -1.78 26 0.00 [bos] : all the [unk] have streets to have their joined '' , streets had , and joined at rome and cleaning in any . [eos] cls1 - sp0 : -53.17 -2.13 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and cleaning at rome and discussed in any . [eos] cls1 - sp1 : -53.24 -2.13 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and organized at rome and discussed in any . [eos] cls1 - sp2 : -53.39 -2.14 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and editor at rome and discussed in any . [eos] cls1 - sp3 : -53.42 -2.14 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and cleaning at general and discussed in any . [eos] cls1 - sp4 : -53.44 -2.14 26 0.28 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and organized at general and discussed in any . [eos] cls2 - sp0 : -51.41 -2.06 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and indifferent in no . [eos] cls2 - sp1 : -51.57 -2.06 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and discussed in no . [eos] cls2 - sp2 : -51.62 -2.06 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and mississippi in no . [eos] cls2 - sp3 : -51.63 -2.07 26 0.68 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and telephone in no . [eos] cls2 - sp4 : -51.65 -2.07 26 0.64 [bos] : all the [unk] have ! to ! their telephone '' , cleaning had , and telephone at her and discussed in any . [eos] cls3 - sp0 : -44.50 -1.78 26 1.00 [bos] she all the [unk] have state to have their telephone '' , telephone only , and telephone at state and crime in be . [eos] cls3 - sp1 : -44.52 -1.78 26 1.00 [bos] she all the [unk] have state to have their telephone '' , housing only , and telephone at state and crime in be . [eos] cls3 - sp2 : -44.62 -1.78 26 1.00 [bos] she all the [unk] have state to have their corner '' , telephone only , and telephone at state and crime in be . [eos] cls3 - sp3 : -44.65 -1.79 26 1.00 [bos] she all the [unk] have state to have their corner '' , housing only , and telephone at state and crime in be . [eos] cls3 - sp4 : -44.66 -1.79 26 1.00 [bos] she all the [unk] have state to have their telephone '' , telephone only , and telephone at state and mississippi in be . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-222 src: none none 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt0: mod/noi/dif/loss/nce/logp -98.54 /-2.82 /-95.72 /0.69/-0.69 -3.94 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt1: mod/noi/dif/loss/nce/logp -98.54 /-2.82 /-95.72 / /-0.69 -3.94 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt2: mod/noi/dif/loss/nce/logp -193.78/-12.76 /-181.02/ /-85.99 -17.62/-1.16 12 [bos] `` all the [unk] have got to have their day [eos] tgt3: mod/noi/dif/loss/nce/logp -291.33/-13.06 /-278.27/ /-183.25 -22.41/-1.00 14 [bos] `` all the [unk] have got to have their day '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -294.18/-13.32 /-280.86/ /-185.84 -18.39/-0.83 17 [bos] `` all the [unk] have got to have their day '' , adam said . [eos] tgt5: mod/noi/dif/loss/nce/logp -275.46/-12.93 /-262.53/ /-167.51 -34.43/-1.62 9 [bos] `` all the [unk] have got . [eos] cls0 - sp0 : -45.03 -1.80 26 0.04 [bos] : all the [unk] have streets to has their later '' , streets out , and cleaning at under and . is any . [eos] cls0 - sp1 : -45.09 -1.80 26 0.04 [bos] '' all the [unk] have streets to has their later '' , streets out , and cleaning at under and . is any . [eos] cls0 - sp2 : -45.15 -1.81 26 0.04 [bos] : all the [unk] have streets to has their later '' , streets out , and cleaning at under and . is no . [eos] cls0 - sp3 : -45.19 -1.81 26 0.04 [bos] '' all the [unk] have streets to has their later '' , streets out , and deck at under and . is any . [eos] cls0 - sp4 : -45.19 -1.81 26 0.04 [bos] : all that [unk] have streets to has their later '' , streets out , and cleaning at under and . is any . [eos] cls1 - sp0 : -56.04 -2.24 26 0.28 [bos] '' all that [unk] have streets to ! their couldn't '' , editor out , and discussed at under and ! in any . [eos] cls1 - sp1 : -56.05 -2.24 26 0.28 [bos] '' all that [unk] have streets to ! their couldn't '' , editor out , and telephone at under and yes in any . [eos] cls1 - sp2 : -56.08 -2.24 26 0.28 [bos] '' all that [unk] have streets to ! their couldn't '' , editor out , and discussed at under and yes in any . [eos] cls1 - sp3 : -56.37 -2.25 26 0.28 [bos] '' all the [unk] have streets to ! their couldn't '' , editor out , and discussed at under and ! in any . [eos] cls1 - sp4 : -56.38 -2.26 26 0.28 [bos] '' all the [unk] have streets to ! their couldn't '' , editor out , and telephone at under and ! in any . [eos] cls2 - sp0 : -53.10 -2.12 26 0.68 [bos] '' all that [unk] have personal to ! their personal '' , telephone out , and telephone at were and life in no . [eos] cls2 - sp1 : -53.20 -2.13 26 0.68 [bos] : all that [unk] have personal to ! their personal '' , telephone out , and telephone at were and life in no . [eos] cls2 - sp2 : -53.38 -2.14 26 0.68 [bos] '' all that [unk] have personal to ! their personal '' , telephone out , and telephone at rather and or in no . [eos] cls2 - sp3 : -53.42 -2.14 26 0.68 [bos] '' all that [unk] have personal to ! their personal '' , telephone out , and telephone at were and or in no . [eos] cls2 - sp4 : -53.45 -2.14 26 0.68 [bos] : all that [unk] have personal to ! their personal '' , telephone out , and telephone at rather and or in no . [eos] cls3 - sp0 : -43.10 -1.72 26 1.00 [bos] she all the [unk] have streets to have their personal '' , telephone out , and thought at were and life in no . [eos] cls3 - sp1 : -43.11 -1.72 26 1.00 [bos] she all the [unk] have personal to have their personal '' , telephone out , and thought at were and life in no . [eos] cls3 - sp2 : -43.12 -1.72 26 1.00 [bos] she all the [unk] have streets to have their personal '' , telephone out , and telephone at were and life in no . [eos] cls3 - sp3 : -43.15 -1.73 26 1.00 [bos] she all the [unk] have personal to have their personal '' , telephone out , and telephone at were and life in no . [eos] cls3 - sp4 : -43.25 -1.73 26 1.00 [bos] she all the [unk] have streets to ! their personal '' , telephone out , and telephone at were and life in no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-223 src: none none 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt0: mod/noi/dif/loss/nce/logp -96.01 /-2.82 /-93.20 /0.69/-0.69 -3.84 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt1: mod/noi/dif/loss/nce/logp -96.01 /-2.82 /-93.20 / /-0.69 -3.84 /-0.11 26 [bos] `` all the [unk] have got to have their day '' , adam said , and glared at william and freddy in turn . [eos] tgt2: mod/noi/dif/loss/nce/logp -165.44/-12.76 /-152.68/ /-60.18 -15.04/-1.16 12 [bos] `` all the [unk] have got to have their day [eos] tgt3: mod/noi/dif/loss/nce/logp -278.62/-13.06 /-265.56/ /-173.06 -21.43/-1.00 14 [bos] `` all the [unk] have got to have their day '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -276.67/-13.32 /-263.36/ /-170.85 -17.29/-0.83 17 [bos] `` all the [unk] have got to have their day '' , adam said . [eos] tgt5: mod/noi/dif/loss/nce/logp -269.00/-12.93 /-256.07/ /-163.56 -33.62/-1.62 9 [bos] `` all the [unk] have got . [eos] cls0 - sp0 : -45.03 -1.80 26 0.04 [bos] : all the [unk] have streets to has their later '' , streets out , and cleaning at under and . is any . [eos] cls0 - sp1 : -45.09 -1.80 26 0.04 [bos] '' all the [unk] have streets to has their later '' , streets out , and cleaning at under and . is any . [eos] cls0 - sp2 : -45.15 -1.81 26 0.04 [bos] : all the [unk] have streets to has their later '' , streets out , and cleaning at under and . is no . [eos] cls0 - sp3 : -45.19 -1.81 26 0.04 [bos] '' all the [unk] have streets to has their later '' , streets out , and deck at under and . is any . [eos] cls0 - sp4 : -45.19 -1.81 26 0.04 [bos] : all that [unk] have streets to has their later '' , streets out , and cleaning at under and . is any . [eos] cls1 - sp0 : -56.04 -2.24 26 0.28 [bos] '' all that [unk] have streets to ! their couldn't '' , editor out , and discussed at under and ! in any . [eos] cls1 - sp1 : -56.05 -2.24 26 0.28 [bos] '' all that [unk] have streets to ! their couldn't '' , editor out , and telephone at under and yes in any . [eos] cls1 - sp2 : -56.08 -2.24 26 0.28 [bos] '' all that [unk] have streets to ! their couldn't '' , editor out , and discussed at under and yes in any . [eos] cls1 - sp3 : -56.37 -2.25 26 0.28 [bos] '' all the [unk] have streets to ! their couldn't '' , editor out , and discussed at under and ! in any . [eos] cls1 - sp4 : -56.38 -2.26 26 0.28 [bos] '' all the [unk] have streets to ! their couldn't '' , editor out , and telephone at under and ! in any . [eos] cls2 - sp0 : -53.10 -2.12 26 0.68 [bos] '' all that [unk] have personal to ! their personal '' , telephone out , and telephone at were and life in no . [eos] cls2 - sp1 : -53.20 -2.13 26 0.68 [bos] : all that [unk] have personal to ! their personal '' , telephone out , and telephone at were and life in no . [eos] cls2 - sp2 : -53.38 -2.14 26 0.68 [bos] '' all that [unk] have personal to ! their personal '' , telephone out , and telephone at rather and or in no . [eos] cls2 - sp3 : -53.42 -2.14 26 0.68 [bos] '' all that [unk] have personal to ! their personal '' , telephone out , and telephone at were and or in no . [eos] cls2 - sp4 : -53.45 -2.14 26 0.68 [bos] : all that [unk] have personal to ! their personal '' , telephone out , and telephone at rather and or in no . [eos] cls3 - sp0 : -43.10 -1.72 26 1.00 [bos] she all the [unk] have streets to have their personal '' , telephone out , and thought at were and life in no . [eos] cls3 - sp1 : -43.11 -1.72 26 1.00 [bos] she all the [unk] have personal to have their personal '' , telephone out , and thought at were and life in no . [eos] cls3 - sp2 : -43.12 -1.72 26 1.00 [bos] she all the [unk] have streets to have their personal '' , telephone out , and telephone at were and life in no . [eos] cls3 - sp3 : -43.15 -1.73 26 1.00 [bos] she all the [unk] have personal to have their personal '' , telephone out , and telephone at were and life in no . [eos] cls3 - sp4 : -43.25 -1.73 26 1.00 [bos] she all the [unk] have streets to ! their personal '' , telephone out , and telephone at were and life in no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-224 src: none none 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt0: mod/noi/dif/loss/nce/logp -147.75/-3.22 /-144.53/0.69/-0.69 -4.77 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt1: mod/noi/dif/loss/nce/logp -147.75/-3.22 /-144.53/ /-0.69 -4.77 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt2: mod/noi/dif/loss/nce/logp -199.18/-13.12 /-186.06/ /-42.22 -6.64 /-0.44 31 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; [eos] tgt3: mod/noi/dif/loss/nce/logp -214.71/-13.45 /-201.26/ /-57.42 -7.40 /-0.46 30 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds [eos] tgt4: mod/noi/dif/loss/nce/logp -320.55/-12.87 /-307.68/ /-163.84 -40.07/-1.61 9 [bos] and it so happened that adjacent . [eos] tgt5: mod/noi/dif/loss/nce/logp -171.48/-14.19 /-157.29/ /-13.45 -5.53 /-0.46 32 [bos] and it so happened that adjacent to the couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] cls0 - sp0 : -56.80 -1.83 32 0.00 [bos] '' it but watching that cleaning to a streets on which she had other cleaning was a other united on which she joined a joined of as ) ; ; [eos] cls0 - sp1 : -56.83 -1.83 32 0.00 [bos] '' it but watching that cleaning to a watching on which she had other cleaning was a other united on which she joined a joined of as ) ; ; [eos] cls0 - sp2 : -56.91 -1.84 32 0.00 [bos] '' it but watching that cleaning to a streets on which she had other cleaning was a other united on which she cleaning a joined of as ) ; ; [eos] cls0 - sp3 : -56.94 -1.84 32 0.00 [bos] '' it but watching that cleaning to a streets on which she had other cleaning was a other united on which she streets a joined of as ) ; ; [eos] cls0 - sp4 : -56.94 -1.84 32 0.00 [bos] '' it but watching that cleaning to a watching on which she had other cleaning was a other united on which she cleaning a joined of as ) ; ; [eos] cls1 - sp0 : -61.83 -1.99 32 0.26 [bos] '' it but personal that crime to a cutting on which she had other cleaning was a other united on which she telephone a joined of as ) ; ; [eos] cls1 - sp1 : -61.83 -1.99 32 0.26 [bos] '' it but 7 that crime to a what's on which she had other cleaning was a other united on which she telephone a joined of as ) ; ; [eos] cls1 - sp2 : -61.83 -1.99 32 0.26 [bos] '' it but personal that crime to a cleaning on which she had other cleaning was a other united on which she telephone a joined of as ) ; ; [eos] cls1 - sp3 : -62.02 -2.00 32 0.26 [bos] '' it but personal that crime to a cleaning on which she had other cleaning was a other united on which she telephone a joined of about ) ; ; [eos] cls1 - sp4 : -62.02 -2.00 32 0.26 [bos] '' it but personal that crime to a cutting on which she had other cleaning was a other united on which she telephone a joined of about ) ; ; [eos] cls2 - sp0 : -64.67 -2.09 32 0.65 [bos] '' it but 7 that crime to a 7 on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls2 - sp1 : -64.71 -2.09 32 0.65 [bos] '' it but personal that crime to a 7 on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls2 - sp2 : -64.73 -2.09 32 0.65 [bos] '' it but 7 that crime to a flung on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls2 - sp3 : -64.74 -2.09 32 0.65 [bos] '' it but 7 that crime to a 7 on which she had other telephone was a other much on which she telephone a telephone of each ) ; ; [eos] cls2 - sp4 : -64.77 -2.09 32 0.65 [bos] '' it but personal that crime to a flung on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls3 - sp0 : -64.62 -2.08 32 0.94 [bos] in it but personal that crime to a corner on which she had state telephone was a other state on which she 2 a 2 of new ) ; ; [eos] cls3 - sp1 : -64.68 -2.09 32 0.94 [bos] in it but personal that crime to a corner on which she had state telephone was a other state on which she 2 a first of new ) ; ; [eos] cls3 - sp2 : -64.70 -2.09 32 0.94 [bos] in it but personal that crime to a personal on which she had state telephone was a other state on which she 2 a way of new ) ; ; [eos] cls3 - sp3 : -64.71 -2.09 32 0.94 [bos] in it but personal that crime to a personal on which she had state telephone was a other state on which she 2 a 2 of new ) ; ; [eos] cls3 - sp4 : -64.78 -2.09 32 0.94 [bos] in it but personal that crime to a personal on which she had state telephone was a other state on which she 2 a first of new ) ; ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-225 src: none none 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt0: mod/noi/dif/loss/nce/logp -136.82/-3.22 /-133.60/0.69/-0.69 -4.41 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt1: mod/noi/dif/loss/nce/logp -136.82/-3.22 /-133.60/ /-0.69 -4.41 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt2: mod/noi/dif/loss/nce/logp -187.52/-13.12 /-174.40/ /-41.50 -6.25 /-0.44 31 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; [eos] tgt3: mod/noi/dif/loss/nce/logp -199.03/-13.45 /-185.57/ /-52.67 -6.86 /-0.46 30 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds [eos] tgt4: mod/noi/dif/loss/nce/logp -314.62/-12.87 /-301.75/ /-168.84 -39.33/-1.61 9 [bos] and it so happened that adjacent . [eos] tgt5: mod/noi/dif/loss/nce/logp -160.46/-14.19 /-146.27/ /-13.37 -5.18 /-0.46 32 [bos] and it so happened that adjacent to the couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] cls0 - sp0 : -56.80 -1.83 32 0.00 [bos] '' it but watching that cleaning to a streets on which she had other cleaning was a other united on which she joined a joined of as ) ; ; [eos] cls0 - sp1 : -56.83 -1.83 32 0.00 [bos] '' it but watching that cleaning to a watching on which she had other cleaning was a other united on which she joined a joined of as ) ; ; [eos] cls0 - sp2 : -56.91 -1.84 32 0.00 [bos] '' it but watching that cleaning to a streets on which she had other cleaning was a other united on which she cleaning a joined of as ) ; ; [eos] cls0 - sp3 : -56.94 -1.84 32 0.00 [bos] '' it but watching that cleaning to a streets on which she had other cleaning was a other united on which she streets a joined of as ) ; ; [eos] cls0 - sp4 : -56.94 -1.84 32 0.00 [bos] '' it but watching that cleaning to a watching on which she had other cleaning was a other united on which she cleaning a joined of as ) ; ; [eos] cls1 - sp0 : -61.83 -1.99 32 0.26 [bos] '' it but personal that crime to a cutting on which she had other cleaning was a other united on which she telephone a joined of as ) ; ; [eos] cls1 - sp1 : -61.83 -1.99 32 0.26 [bos] '' it but 7 that crime to a what's on which she had other cleaning was a other united on which she telephone a joined of as ) ; ; [eos] cls1 - sp2 : -61.83 -1.99 32 0.26 [bos] '' it but personal that crime to a cleaning on which she had other cleaning was a other united on which she telephone a joined of as ) ; ; [eos] cls1 - sp3 : -62.02 -2.00 32 0.26 [bos] '' it but personal that crime to a cleaning on which she had other cleaning was a other united on which she telephone a joined of about ) ; ; [eos] cls1 - sp4 : -62.02 -2.00 32 0.26 [bos] '' it but personal that crime to a cutting on which she had other cleaning was a other united on which she telephone a joined of about ) ; ; [eos] cls2 - sp0 : -64.67 -2.09 32 0.65 [bos] '' it but 7 that crime to a 7 on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls2 - sp1 : -64.71 -2.09 32 0.65 [bos] '' it but personal that crime to a 7 on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls2 - sp2 : -64.73 -2.09 32 0.65 [bos] '' it but 7 that crime to a flung on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls2 - sp3 : -64.74 -2.09 32 0.65 [bos] '' it but 7 that crime to a 7 on which she had other telephone was a other much on which she telephone a telephone of each ) ; ; [eos] cls2 - sp4 : -64.77 -2.09 32 0.65 [bos] '' it but personal that crime to a flung on which she had other telephone was a other much on which she telephone a telephone of such ) ; ; [eos] cls3 - sp0 : -64.62 -2.08 32 0.94 [bos] in it but personal that crime to a corner on which she had state telephone was a other state on which she 2 a 2 of new ) ; ; [eos] cls3 - sp1 : -64.68 -2.09 32 0.94 [bos] in it but personal that crime to a corner on which she had state telephone was a other state on which she 2 a first of new ) ; ; [eos] cls3 - sp2 : -64.70 -2.09 32 0.94 [bos] in it but personal that crime to a personal on which she had state telephone was a other state on which she 2 a way of new ) ; ; [eos] cls3 - sp3 : -64.71 -2.09 32 0.94 [bos] in it but personal that crime to a personal on which she had state telephone was a other state on which she 2 a 2 of new ) ; ; [eos] cls3 - sp4 : -64.78 -2.09 32 0.94 [bos] in it but personal that crime to a personal on which she had state telephone was a other state on which she 2 a first of new ) ; ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-226 src: none none 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt0: mod/noi/dif/loss/nce/logp -146.86/-3.22 /-143.64/0.69/-0.69 -4.74 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt1: mod/noi/dif/loss/nce/logp -146.86/-3.22 /-143.64/ /-0.69 -4.74 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt2: mod/noi/dif/loss/nce/logp -195.57/-13.12 /-182.45/ /-39.50 -6.52 /-0.44 31 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; [eos] tgt3: mod/noi/dif/loss/nce/logp -208.33/-13.45 /-194.88/ /-51.94 -7.18 /-0.46 30 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds [eos] tgt4: mod/noi/dif/loss/nce/logp -317.77/-12.87 /-304.90/ /-161.95 -39.72/-1.61 9 [bos] and it so happened that adjacent . [eos] tgt5: mod/noi/dif/loss/nce/logp -170.17/-14.19 /-155.98/ /-13.03 -5.49 /-0.46 32 [bos] and it so happened that adjacent to the couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] cls0 - sp0 : -49.73 -1.60 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she streets a streets of its later ; ; [eos] cls0 - sp1 : -49.82 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she streets a streets of its rome ; ; [eos] cls0 - sp2 : -49.84 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she couldn't a streets of its later ; ; [eos] cls0 - sp3 : -49.91 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she couldn't a streets of its rome ; ; [eos] cls0 - sp4 : -49.91 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had joined cleaning was a . is on which she streets a streets of its later ; ; [eos] cls1 - sp0 : -62.93 -2.03 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into firms on which she couldn't a streets of its later ; ; [eos] cls1 - sp1 : -63.18 -2.04 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into firms on which she couldn't a streets of its were ; ; [eos] cls1 - sp2 : -63.24 -2.04 32 0.29 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into firms on which she couldn't a streets of its later ; ; [eos] cls1 - sp3 : -63.29 -2.04 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a so did on which she couldn't a streets of its later ; ; [eos] cls1 - sp4 : -63.29 -2.04 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into streets on which she couldn't a streets of its later ; ; [eos] cls2 - sp0 : -67.86 -2.19 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of war yes ; ; [eos] cls2 - sp1 : -68.08 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of war later ; ; [eos] cls2 - sp2 : -68.21 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of life yes ; ; [eos] cls2 - sp3 : -68.24 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she first a telephone of life yes ; ; [eos] cls2 - sp4 : -68.27 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of streets yes ; ; [eos] cls3 - sp0 : -62.54 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of life life ; ; [eos] cls3 - sp1 : -62.55 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of streets life ; ; [eos] cls3 - sp2 : -62.63 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of state life ; ; [eos] cls3 - sp3 : -62.66 -2.02 32 0.94 [bos] : it but later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of life life ; ; [eos] cls3 - sp4 : -62.67 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she almost a telephone of life life ; ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-227 src: none none 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt0: mod/noi/dif/loss/nce/logp -138.16/-3.22 /-134.94/0.69/-0.69 -4.46 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt1: mod/noi/dif/loss/nce/logp -138.16/-3.22 /-134.94/ /-0.69 -4.46 /-0.10 32 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] tgt2: mod/noi/dif/loss/nce/logp -186.60/-13.12 /-173.48/ /-39.23 -6.22 /-0.44 31 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; [eos] tgt3: mod/noi/dif/loss/nce/logp -197.48/-13.45 /-184.02/ /-49.77 -6.81 /-0.46 30 [bos] and it so happened that adjacent to a couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds [eos] tgt4: mod/noi/dif/loss/nce/logp -313.24/-12.87 /-300.37/ /-166.12 -39.15/-1.61 9 [bos] and it so happened that adjacent . [eos] tgt5: mod/noi/dif/loss/nce/logp -161.23/-14.19 /-147.04/ /-12.79 -5.20 /-0.46 32 [bos] and it so happened that adjacent to the couch on which she had taken refuge was a small table on which she noted a vase of red rosebuds ; ; [eos] cls0 - sp0 : -49.73 -1.60 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she streets a streets of its later ; ; [eos] cls0 - sp1 : -49.82 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she streets a streets of its rome ; ; [eos] cls0 - sp2 : -49.84 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she couldn't a streets of its later ; ; [eos] cls0 - sp3 : -49.91 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had streets cleaning was a . is on which she couldn't a streets of its rome ; ; [eos] cls0 - sp4 : -49.91 -1.61 32 0.03 [bos] : it are any that preceding to a cleaning on which she had joined cleaning was a . is on which she streets a streets of its later ; ; [eos] cls1 - sp0 : -62.93 -2.03 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into firms on which she couldn't a streets of its later ; ; [eos] cls1 - sp1 : -63.18 -2.04 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into firms on which she couldn't a streets of its were ; ; [eos] cls1 - sp2 : -63.24 -2.04 32 0.29 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into firms on which she couldn't a streets of its later ; ; [eos] cls1 - sp3 : -63.29 -2.04 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a so did on which she couldn't a streets of its later ; ; [eos] cls1 - sp4 : -63.29 -2.04 32 0.32 [bos] '' it but later that crime to a telephone on which she had couldn't telephone was a into streets on which she couldn't a streets of its later ; ; [eos] cls2 - sp0 : -67.86 -2.19 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of war yes ; ; [eos] cls2 - sp1 : -68.08 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of war later ; ; [eos] cls2 - sp2 : -68.21 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of life yes ; ; [eos] cls2 - sp3 : -68.24 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she first a telephone of life yes ; ; [eos] cls2 - sp4 : -68.27 -2.20 32 0.68 [bos] '' it but later that crime to a telephone on which she had telephone telephone was a so did on which she almost a telephone of streets yes ; ; [eos] cls3 - sp0 : -62.54 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of life life ; ; [eos] cls3 - sp1 : -62.55 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of streets life ; ; [eos] cls3 - sp2 : -62.63 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of state life ; ; [eos] cls3 - sp3 : -62.66 -2.02 32 0.94 [bos] : it but later that crime to a telephone on which she had corner telephone was a state streets on which she first a telephone of life life ; ; [eos] cls3 - sp4 : -62.67 -2.02 32 0.94 [bos] : it so later that crime to a telephone on which she had corner telephone was a state streets on which she almost a telephone of life life ; ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-228 src: none none 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -221.75/-5.87 /-215.88/0.69/-0.69 -3.96 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -221.75/-5.87 /-215.88/ /-0.69 -3.96 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -341.80/-13.24 /-328.56/ /-113.37 -21.36/-0.83 17 [bos] `` you are bound to get involved with people when you have children '' . [eos] tgt3: mod/noi/dif/loss/nce/logp -263.99/-13.10 /-250.89/ /-35.69 -18.86/-0.94 15 [bos] `` you are bound to get involved with people when you have children [eos] tgt4: mod/noi/dif/loss/nce/logp -337.88/-12.57 /-325.31/ /-110.12 -22.53/-0.84 16 [bos] `` you are bound to get involved with people when you have children . [eos] tgt5: mod/noi/dif/loss/nce/logp -382.22/-14.09 /-368.13/ /-152.94 -15.29/-0.56 26 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting . [eos] cls0 - sp0 : -78.30 -2.06 39 0.03 [bos] '' ) are were to streets government with that when you up may '' , society -- very has at they first had , `` so it is its to preceding that two with years ) there [eos] cls0 - sp1 : -78.35 -2.06 39 0.03 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first had , `` so it is its to preceding that two with years ) there [eos] cls0 - sp2 : -86.38 -2.06 43 0.02 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first were , `` so it is its to preceding that two with years ) there within are not that [eos] cls0 - sp3 : -86.40 -2.06 43 0.02 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first had , `` so it is its to preceding that two with years ) there within are not that [eos] cls0 - sp4 : -86.43 -2.06 43 0.02 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first had , `` so it is its to preceding that two with years ) there within are not united [eos] cls1 - sp0 : -128.25 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and general ) , but that who that were '' . [eos] cls1 - sp1 : -128.28 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and rome ) , but that who that were '' . [eos] cls1 - sp2 : -128.43 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and general ) , but that who that had '' . [eos] cls1 - sp3 : -128.43 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when ) up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and general ) , but that who that were '' . [eos] cls1 - sp4 : -128.47 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and rome ) , but that who that had '' . [eos] cls2 - sp0 : -132.84 -2.37 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who so and '' . [eos] cls2 - sp1 : -133.29 -2.38 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who but and '' . [eos] cls2 - sp2 : -133.44 -2.38 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who so had '' . [eos] cls2 - sp3 : -133.49 -2.38 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who so were '' . [eos] cls2 - sp4 : -133.60 -2.39 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who state and '' . [eos] cls3 - sp0 : -119.48 -2.13 57 1.00 [bos] '' ) are were to way state with people when you who center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) way number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp1 : -119.50 -2.13 57 1.00 [bos] '' ) are were to way state with people when you have center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) way number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp2 : -119.53 -2.13 57 1.00 [bos] '' ) are were to way state with people when you who center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) first number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp3 : -119.59 -2.14 57 1.00 [bos] '' ) are were to way state with people when you have center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) first number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp4 : -119.59 -2.14 57 1.00 [bos] '' ) are were to way state with people when you have center '' , people -- center has at they first life , `` so it is been to 2 that between with some you first number are not state number much state and streets ) , but that who state and '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-229 src: none none 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -216.48/-5.87 /-210.61/0.69/-0.69 -3.87 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -216.48/-5.87 /-210.61/ /-0.69 -3.87 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -338.99/-13.24 /-325.76/ /-115.83 -21.19/-0.83 17 [bos] `` you are bound to get involved with people when you have children '' . [eos] tgt3: mod/noi/dif/loss/nce/logp -264.10/-13.10 /-250.99/ /-41.07 -18.86/-0.94 15 [bos] `` you are bound to get involved with people when you have children [eos] tgt4: mod/noi/dif/loss/nce/logp -338.10/-12.57 /-325.53/ /-115.61 -22.54/-0.84 16 [bos] `` you are bound to get involved with people when you have children . [eos] tgt5: mod/noi/dif/loss/nce/logp -380.94/-14.09 /-366.85/ /-156.93 -15.24/-0.56 26 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting . [eos] cls0 - sp0 : -78.30 -2.06 39 0.03 [bos] '' ) are were to streets government with that when you up may '' , society -- very has at they first had , `` so it is its to preceding that two with years ) there [eos] cls0 - sp1 : -78.35 -2.06 39 0.03 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first had , `` so it is its to preceding that two with years ) there [eos] cls0 - sp2 : -86.38 -2.06 43 0.02 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first were , `` so it is its to preceding that two with years ) there within are not that [eos] cls0 - sp3 : -86.40 -2.06 43 0.02 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first had , `` so it is its to preceding that two with years ) there within are not that [eos] cls0 - sp4 : -86.43 -2.06 43 0.02 [bos] '' ) are were to streets government with that when you up may '' , society -- very any at they first had , `` so it is its to preceding that two with years ) there within are not united [eos] cls1 - sp0 : -128.25 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and general ) , but that who that were '' . [eos] cls1 - sp1 : -128.28 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and rome ) , but that who that were '' . [eos] cls1 - sp2 : -128.43 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and general ) , but that who that had '' . [eos] cls1 - sp3 : -128.43 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when ) up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and general ) , but that who that were '' . [eos] cls1 - sp4 : -128.47 -2.29 57 0.25 [bos] '' ) are were to 2 may with that when you up may '' , deck -- very has at into first were , `` so it is been to preceding that between with out you she within are not when within its united and rome ) , but that who that had '' . [eos] cls2 - sp0 : -132.84 -2.37 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who so and '' . [eos] cls2 - sp1 : -133.29 -2.38 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who but and '' . [eos] cls2 - sp2 : -133.44 -2.38 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who so had '' . [eos] cls2 - sp3 : -133.49 -2.38 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who so were '' . [eos] cls2 - sp4 : -133.60 -2.39 57 0.73 [bos] '' ) are were to 2 may with that when property have per is , thought -- how has at into first were , `` so it is been to 2 that between with years you first number are not `` number much when and streets ) , but that who state and '' . [eos] cls3 - sp0 : -119.48 -2.13 57 1.00 [bos] '' ) are were to way state with people when you who center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) way number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp1 : -119.50 -2.13 57 1.00 [bos] '' ) are were to way state with people when you have center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) way number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp2 : -119.53 -2.13 57 1.00 [bos] '' ) are were to way state with people when you who center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) first number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp3 : -119.59 -2.14 57 1.00 [bos] '' ) are were to way state with people when you have center '' , people -- center has at they first life , `` so it is been to 2 that between with some ) first number are not state number much state and streets ) , but that who state and '' . [eos] cls3 - sp4 : -119.59 -2.14 57 1.00 [bos] '' ) are were to way state with people when you have center '' , people -- center has at they first life , `` so it is been to 2 that between with some you first number are not state number much state and streets ) , but that who state and '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-230 src: none none 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -208.26/-5.87 /-202.39/0.69/-0.69 -3.72 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -208.26/-5.87 /-202.39/ /-0.69 -3.72 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -334.82/-13.24 /-321.58/ /-119.89 -20.93/-0.83 17 [bos] `` you are bound to get involved with people when you have children '' . [eos] tgt3: mod/noi/dif/loss/nce/logp -253.05/-13.10 /-239.95/ /-38.25 -18.08/-0.94 15 [bos] `` you are bound to get involved with people when you have children [eos] tgt4: mod/noi/dif/loss/nce/logp -332.54/-12.57 /-319.97/ /-118.28 -22.17/-0.84 16 [bos] `` you are bound to get involved with people when you have children . [eos] tgt5: mod/noi/dif/loss/nce/logp -370.67/-14.09 /-356.58/ /-154.88 -14.83/-0.56 26 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting . [eos] cls0 - sp0 : -96.76 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not united states its united and preceding [eos] cls0 - sp1 : -96.82 -2.06 48 0.02 [bos] '' you are were to would states with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not united states its united and preceding [eos] cls0 - sp2 : -96.89 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not are states its united and preceding [eos] cls0 - sp3 : -96.90 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not that states its united and preceding [eos] cls0 - sp4 : -96.98 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not very states its united and preceding [eos] cls1 - sp0 : -126.21 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you was out are not when under its has and preceding [eos] cls1 - sp1 : -126.28 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you was per are not when under its has and preceding [eos] cls1 - sp2 : -126.30 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you she out are not when under its has and preceding [eos] cls1 - sp3 : -126.39 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you she per are not when under its has and preceding [eos] cls1 - sp4 : -126.43 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you would out are not when under its has and preceding [eos] cls2 - sp0 : -154.96 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but life '' . [eos] cls2 - sp1 : -154.99 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but were '' . [eos] cls2 - sp2 : -154.99 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but and '' . [eos] cls2 - sp3 : -155.06 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who so life '' . [eos] cls2 - sp4 : -155.11 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but other '' . [eos] cls3 - sp0 : -116.08 -2.07 57 0.96 [bos] '' you are were to first much with people when you have our '' , streets had people any at they first ( , `` so it is about to any that and with were you first life are not state state this new and example example , but that who so life '' . [eos] cls3 - sp1 : -116.08 -2.07 57 0.96 [bos] '' you are were to be state with people when you have our '' , state had people any at they first ( , `` so it is about to any that and with were you first life are not state state this new and example example , but that who so life '' . [eos] cls3 - sp2 : -116.10 -2.07 57 0.96 [bos] '' you are were to be state with people when you have our '' , state had people any at they first ( , `` so it is about to any that and with were you first life are not state streets this new and example example , but that who so life '' . [eos] cls3 - sp3 : -116.11 -2.07 57 0.96 [bos] '' you are were to first much with people when you have our '' , streets had people any at they first ( , `` so it is about to any that and with were you first life are not state streets this new and example example , but that who so life '' . [eos] cls3 - sp4 : -116.12 -2.07 57 0.96 [bos] '' you are were to be state with people when you have our '' , state had people any at they first ( , `` so it is about to any that and with were you first life are not state state this new and example example , but that who over life '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-231 src: none none 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -204.57/-5.87 /-198.70/0.69/-0.69 -3.65 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -204.57/-5.87 /-198.70/ /-0.69 -3.65 /-0.10 57 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting , `` so it is good to know that those with whom you get involved are not just dreary little housewives and dull husbands , but people who do things '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -332.81/-13.24 /-319.58/ /-121.57 -20.80/-0.83 17 [bos] `` you are bound to get involved with people when you have children '' . [eos] tgt3: mod/noi/dif/loss/nce/logp -253.54/-13.10 /-240.43/ /-42.43 -18.11/-0.94 15 [bos] `` you are bound to get involved with people when you have children [eos] tgt4: mod/noi/dif/loss/nce/logp -332.50/-12.57 /-319.93/ /-121.93 -22.17/-0.84 16 [bos] `` you are bound to get involved with people when you have children . [eos] tgt5: mod/noi/dif/loss/nce/logp -368.76/-14.09 /-354.67/ /-156.66 -14.75/-0.56 26 [bos] `` you are bound to get involved with people when you have children '' , fran had told me at our first meeting . [eos] cls0 - sp0 : -96.76 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not united states its united and preceding [eos] cls0 - sp1 : -96.82 -2.06 48 0.02 [bos] '' you are were to would states with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not united states its united and preceding [eos] cls0 - sp2 : -96.89 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not are states its united and preceding [eos] cls0 - sp3 : -96.90 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not that states its united and preceding [eos] cls0 - sp4 : -96.98 -2.06 48 0.02 [bos] '' you are were to first two with that when you have over '' , activity had by any at they first ) , `` so it is its to any that -- with were you first states are not very states its united and preceding [eos] cls1 - sp0 : -126.21 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you was out are not when under its has and preceding [eos] cls1 - sp1 : -126.28 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you was per are not when under its has and preceding [eos] cls1 - sp2 : -126.30 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you she out are not when under its has and preceding [eos] cls1 - sp3 : -126.39 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you she per are not when under its has and preceding [eos] cls1 - sp4 : -126.43 -2.69 48 0.28 [bos] '' you are rather to first between with when when you that use '' , activity had by any at they first ( , `` so it is or to any that and with were you would out are not when under its has and preceding [eos] cls2 - sp0 : -154.96 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but life '' . [eos] cls2 - sp1 : -154.99 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but were '' . [eos] cls2 - sp2 : -154.99 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but and '' . [eos] cls2 - sp3 : -155.06 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who so life '' . [eos] cls2 - sp4 : -155.11 -2.77 57 0.73 [bos] '' you are were to first much with people when you but over '' , gloomy -- people any at they first ( , `` so it is about to later that and with were when first number are not state number this has and example gloomy , but that who but other '' . [eos] cls3 - sp0 : -116.08 -2.07 57 0.96 [bos] '' you are were to first much with people when you have our '' , streets had people any at they first ( , `` so it is about to any that and with were you first life are not state state this new and example example , but that who so life '' . [eos] cls3 - sp1 : -116.08 -2.07 57 0.96 [bos] '' you are were to be state with people when you have our '' , state had people any at they first ( , `` so it is about to any that and with were you first life are not state state this new and example example , but that who so life '' . [eos] cls3 - sp2 : -116.10 -2.07 57 0.96 [bos] '' you are were to be state with people when you have our '' , state had people any at they first ( , `` so it is about to any that and with were you first life are not state streets this new and example example , but that who so life '' . [eos] cls3 - sp3 : -116.11 -2.07 57 0.96 [bos] '' you are were to first much with people when you have our '' , streets had people any at they first ( , `` so it is about to any that and with were you first life are not state streets this new and example example , but that who so life '' . [eos] cls3 - sp4 : -116.12 -2.07 57 0.96 [bos] '' you are were to be state with people when you have our '' , state had people any at they first ( , `` so it is about to any that and with were you first life are not state state this new and example example , but that who over life '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-232 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.50 /-0.97 /-30.53 /0.79/-0.79 -3.50 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.50 /-0.97 /-30.53 / /-0.79 -3.50 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -57.15 /-11.91 /-45.23 / /-15.50 -7.14 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -50.91 /-12.66 /-38.25 / /-8.52 -5.66 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.22 /-12.16 /-58.06 / /-28.33 -7.02 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -54.70 /-22.60 /-32.10 / /-2.36 -6.08 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -11.19 -1.87 7 0.00 [bos] ! ! ! at ! [eos] cls0 - sp1 : -11.63 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp2 : -11.65 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp3 : -11.80 -1.97 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp4 : -11.99 -2.00 7 0.17 [bos] ! ! ! at ! [eos] cls1 - sp0 : -11.60 -1.93 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp1 : -11.81 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp2 : -11.84 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp3 : -12.22 -2.04 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp4 : -12.82 -1.42 10 0.44 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp0 : -11.51 -1.28 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp1 : -12.00 -1.33 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp2 : -12.15 -1.35 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp3 : -12.18 -1.35 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp4 : -12.38 -1.38 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp0 : -10.40 -1.16 10 0.89 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp1 : -11.20 -1.24 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp2 : -11.37 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp3 : -11.38 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp4 : -11.48 -1.28 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-233 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -37.76 /-0.97 /-36.79 /0.85/-0.85 -4.20 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -37.76 /-0.97 /-36.79 / /-0.85 -4.20 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -71.74 /-11.91 /-59.82 / /-23.88 -8.97 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -61.40 /-12.66 /-48.74 / /-12.80 -6.82 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -76.56 /-12.16 /-64.40 / /-28.46 -7.66 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -60.47 /-22.60 /-37.87 / /-1.93 -6.72 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -11.19 -1.87 7 0.00 [bos] ! ! ! at ! [eos] cls0 - sp1 : -11.63 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp2 : -11.65 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp3 : -11.80 -1.97 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp4 : -11.99 -2.00 7 0.17 [bos] ! ! ! at ! [eos] cls1 - sp0 : -11.60 -1.93 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp1 : -11.81 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp2 : -11.84 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp3 : -12.22 -2.04 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp4 : -12.82 -1.42 10 0.44 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp0 : -11.51 -1.28 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp1 : -12.00 -1.33 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp2 : -12.15 -1.35 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp3 : -12.18 -1.35 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp4 : -12.38 -1.38 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp0 : -10.40 -1.16 10 0.89 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp1 : -11.20 -1.24 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp2 : -11.37 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp3 : -11.38 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp4 : -11.48 -1.28 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-234 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.25 /-0.97 /-33.28 /0.72/-0.72 -3.81 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.25 /-0.97 /-33.28 / /-0.72 -3.81 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -63.34 /-11.91 /-51.43 / /-18.87 -7.92 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -52.94 /-12.66 /-40.28 / /-7.72 -5.88 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -71.04 /-12.16 /-58.88 / /-26.32 -7.10 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.71 /-22.60 /-36.11 / /-3.55 -6.52 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -17.49 -1.94 10 0.22 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp1 : -17.71 -1.97 10 0.11 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp2 : -17.82 -1.98 10 0.00 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp3 : -17.92 -1.99 10 0.11 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp4 : -17.98 -2.00 10 0.11 [bos] i it couldn't at ! ! ! . [eos] cls1 - sp0 : -14.76 -2.46 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp1 : -14.79 -2.47 7 0.33 [bos] ! ! she at ! [eos] cls1 - sp2 : -14.88 -2.48 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp3 : -15.25 -2.54 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp4 : -15.59 -2.60 7 0.33 [bos] ! ! ! at ! [eos] cls2 - sp0 : -14.33 -2.39 7 0.67 [bos] ! ! ! at ! [eos] cls2 - sp1 : -14.83 -2.47 7 0.50 [bos] ! ! ! or ! [eos] cls2 - sp2 : -14.86 -2.48 7 0.67 [bos] ! ! 7 at ! [eos] cls2 - sp3 : -15.11 -2.52 7 0.67 [bos] ! ! don't at ! [eos] cls2 - sp4 : -15.20 -2.53 7 0.50 [bos] ! ! ! at ! [eos] cls3 - sp0 : -14.99 -2.50 7 1.00 [bos] ! ! don't at ! [eos] cls3 - sp1 : -16.28 -1.81 10 0.89 [bos] ! ! she at ! ! ! . [eos] cls3 - sp2 : -16.30 -1.81 10 0.78 [bos] ! ! ! at ! ! ! . [eos] cls3 - sp3 : -16.39 -1.82 10 0.89 [bos] ! ! don't at ! ! ! . [eos] cls3 - sp4 : -16.42 -1.82 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-235 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -38.88 /-0.97 /-37.90 /0.74/-0.74 -4.32 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -38.88 /-0.97 /-37.90 / /-0.74 -4.32 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -75.46 /-11.91 /-63.54 / /-26.38 -9.43 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -61.87 /-12.66 /-49.21 / /-12.04 -6.87 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -76.05 /-12.16 /-63.89 / /-26.73 -7.60 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -62.84 /-22.60 /-40.24 / /-3.08 -6.98 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -17.49 -1.94 10 0.22 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp1 : -17.71 -1.97 10 0.11 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp2 : -17.82 -1.98 10 0.00 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp3 : -17.92 -1.99 10 0.11 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp4 : -17.98 -2.00 10 0.11 [bos] i it couldn't at ! ! ! . [eos] cls1 - sp0 : -14.76 -2.46 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp1 : -14.79 -2.47 7 0.33 [bos] ! ! she at ! [eos] cls1 - sp2 : -14.88 -2.48 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp3 : -15.25 -2.54 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp4 : -15.59 -2.60 7 0.33 [bos] ! ! ! at ! [eos] cls2 - sp0 : -14.33 -2.39 7 0.67 [bos] ! ! ! at ! [eos] cls2 - sp1 : -14.83 -2.47 7 0.50 [bos] ! ! ! or ! [eos] cls2 - sp2 : -14.86 -2.48 7 0.67 [bos] ! ! 7 at ! [eos] cls2 - sp3 : -15.11 -2.52 7 0.67 [bos] ! ! don't at ! [eos] cls2 - sp4 : -15.20 -2.53 7 0.50 [bos] ! ! ! at ! [eos] cls3 - sp0 : -14.99 -2.50 7 1.00 [bos] ! ! don't at ! [eos] cls3 - sp1 : -16.28 -1.81 10 0.89 [bos] ! ! she at ! ! ! . [eos] cls3 - sp2 : -16.30 -1.81 10 0.78 [bos] ! ! ! at ! ! ! . [eos] cls3 - sp3 : -16.39 -1.82 10 0.89 [bos] ! ! don't at ! ! ! . [eos] cls3 - sp4 : -16.42 -1.82 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-236 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.50 /-0.97 /-30.53 /0.79/-0.79 -3.50 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.50 /-0.97 /-30.53 / /-0.79 -3.50 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -57.15 /-11.91 /-45.23 / /-15.50 -7.14 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -50.91 /-12.66 /-38.25 / /-8.52 -5.66 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.22 /-12.16 /-58.06 / /-28.33 -7.02 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -54.70 /-22.60 /-32.10 / /-2.36 -6.08 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -11.19 -1.87 7 0.00 [bos] ! ! ! at ! [eos] cls0 - sp1 : -11.63 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp2 : -11.65 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp3 : -11.80 -1.97 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp4 : -11.99 -2.00 7 0.17 [bos] ! ! ! at ! [eos] cls1 - sp0 : -11.60 -1.93 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp1 : -11.81 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp2 : -11.84 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp3 : -12.22 -2.04 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp4 : -12.82 -1.42 10 0.44 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp0 : -11.51 -1.28 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp1 : -12.00 -1.33 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp2 : -12.15 -1.35 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp3 : -12.18 -1.35 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp4 : -12.38 -1.38 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp0 : -10.40 -1.16 10 0.89 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp1 : -11.20 -1.24 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp2 : -11.37 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp3 : -11.38 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp4 : -11.48 -1.28 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-237 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -37.76 /-0.97 /-36.79 /0.85/-0.85 -4.20 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -37.76 /-0.97 /-36.79 / /-0.85 -4.20 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -71.74 /-11.91 /-59.82 / /-23.88 -8.97 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -61.40 /-12.66 /-48.74 / /-12.80 -6.82 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -76.56 /-12.16 /-64.40 / /-28.46 -7.66 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -60.47 /-22.60 /-37.87 / /-1.93 -6.72 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -11.19 -1.87 7 0.00 [bos] ! ! ! at ! [eos] cls0 - sp1 : -11.63 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp2 : -11.65 -1.94 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp3 : -11.80 -1.97 7 0.17 [bos] ! ! ! at ! [eos] cls0 - sp4 : -11.99 -2.00 7 0.17 [bos] ! ! ! at ! [eos] cls1 - sp0 : -11.60 -1.93 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp1 : -11.81 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp2 : -11.84 -1.97 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp3 : -12.22 -2.04 7 0.33 [bos] ! ! ! ; ! [eos] cls1 - sp4 : -12.82 -1.42 10 0.44 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp0 : -11.51 -1.28 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp1 : -12.00 -1.33 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp2 : -12.15 -1.35 10 0.67 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp3 : -12.18 -1.35 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls2 - sp4 : -12.38 -1.38 10 0.56 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp0 : -10.40 -1.16 10 0.89 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp1 : -11.20 -1.24 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp2 : -11.37 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp3 : -11.38 -1.26 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] cls3 - sp4 : -11.48 -1.28 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-238 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.25 /-0.97 /-33.28 /0.72/-0.72 -3.81 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.25 /-0.97 /-33.28 / /-0.72 -3.81 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -63.34 /-11.91 /-51.43 / /-18.87 -7.92 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -52.94 /-12.66 /-40.28 / /-7.72 -5.88 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -71.04 /-12.16 /-58.88 / /-26.32 -7.10 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.71 /-22.60 /-36.11 / /-3.55 -6.52 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -17.49 -1.94 10 0.22 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp1 : -17.71 -1.97 10 0.11 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp2 : -17.82 -1.98 10 0.00 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp3 : -17.92 -1.99 10 0.11 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp4 : -17.98 -2.00 10 0.11 [bos] i it couldn't at ! ! ! . [eos] cls1 - sp0 : -14.76 -2.46 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp1 : -14.79 -2.47 7 0.33 [bos] ! ! she at ! [eos] cls1 - sp2 : -14.88 -2.48 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp3 : -15.25 -2.54 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp4 : -15.59 -2.60 7 0.33 [bos] ! ! ! at ! [eos] cls2 - sp0 : -14.33 -2.39 7 0.67 [bos] ! ! ! at ! [eos] cls2 - sp1 : -14.83 -2.47 7 0.50 [bos] ! ! ! or ! [eos] cls2 - sp2 : -14.86 -2.48 7 0.67 [bos] ! ! 7 at ! [eos] cls2 - sp3 : -15.11 -2.52 7 0.67 [bos] ! ! don't at ! [eos] cls2 - sp4 : -15.20 -2.53 7 0.50 [bos] ! ! ! at ! [eos] cls3 - sp0 : -14.99 -2.50 7 1.00 [bos] ! ! don't at ! [eos] cls3 - sp1 : -16.28 -1.81 10 0.89 [bos] ! ! she at ! ! ! . [eos] cls3 - sp2 : -16.30 -1.81 10 0.78 [bos] ! ! ! at ! ! ! . [eos] cls3 - sp3 : -16.39 -1.82 10 0.89 [bos] ! ! don't at ! ! ! . [eos] cls3 - sp4 : -16.42 -1.82 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-239 src: none none 10 [bos] i couldn't feel at home among them . [eos] tgt0: mod/noi/dif/loss/nce/logp -38.88 /-0.97 /-37.90 /0.74/-0.74 -4.32 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt1: mod/noi/dif/loss/nce/logp -38.88 /-0.97 /-37.90 / /-0.74 -4.32 /-0.11 10 [bos] i couldn't feel at home among them . [eos] tgt2: mod/noi/dif/loss/nce/logp -75.46 /-11.91 /-63.54 / /-26.38 -9.43 /-1.49 9 [bos] i couldn't feel at home among them [eos] tgt3: mod/noi/dif/loss/nce/logp -61.87 /-12.66 /-49.21 / /-12.04 -6.87 /-1.41 10 [bos] i couldn't feel at home among puts . [eos] tgt4: mod/noi/dif/loss/nce/logp -76.05 /-12.16 /-63.89 / /-26.73 -7.60 /-1.22 11 [bos] i couldn't feel at home among them . . [eos] tgt5: mod/noi/dif/loss/nce/logp -62.84 /-22.60 /-40.24 / /-3.08 -6.98 /-2.51 10 [bos] i . feel at home among them . [eos] cls0 - sp0 : -17.49 -1.94 10 0.22 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp1 : -17.71 -1.97 10 0.11 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp2 : -17.82 -1.98 10 0.00 [bos] i couldn't joined at ! ! ! . [eos] cls0 - sp3 : -17.92 -1.99 10 0.11 [bos] ! couldn't joined at ! ! ! . [eos] cls0 - sp4 : -17.98 -2.00 10 0.11 [bos] i it couldn't at ! ! ! . [eos] cls1 - sp0 : -14.76 -2.46 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp1 : -14.79 -2.47 7 0.33 [bos] ! ! she at ! [eos] cls1 - sp2 : -14.88 -2.48 7 0.33 [bos] ! ! couldn't at ! [eos] cls1 - sp3 : -15.25 -2.54 7 0.33 [bos] ! ! ! at ! [eos] cls1 - sp4 : -15.59 -2.60 7 0.33 [bos] ! ! ! at ! [eos] cls2 - sp0 : -14.33 -2.39 7 0.67 [bos] ! ! ! at ! [eos] cls2 - sp1 : -14.83 -2.47 7 0.50 [bos] ! ! ! or ! [eos] cls2 - sp2 : -14.86 -2.48 7 0.67 [bos] ! ! 7 at ! [eos] cls2 - sp3 : -15.11 -2.52 7 0.67 [bos] ! ! don't at ! [eos] cls2 - sp4 : -15.20 -2.53 7 0.50 [bos] ! ! ! at ! [eos] cls3 - sp0 : -14.99 -2.50 7 1.00 [bos] ! ! don't at ! [eos] cls3 - sp1 : -16.28 -1.81 10 0.89 [bos] ! ! she at ! ! ! . [eos] cls3 - sp2 : -16.30 -1.81 10 0.78 [bos] ! ! ! at ! ! ! . [eos] cls3 - sp3 : -16.39 -1.82 10 0.89 [bos] ! ! don't at ! ! ! . [eos] cls3 - sp4 : -16.42 -1.82 10 0.78 [bos] ! ! ! at ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-240 src: none none 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt0: mod/noi/dif/loss/nce/logp -108.83/-1.99 /-106.85/0.69/-0.69 -5.44 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt1: mod/noi/dif/loss/nce/logp -108.83/-1.99 /-106.85/ /-0.69 -5.44 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt2: mod/noi/dif/loss/nce/logp -288.38/-12.10 /-276.28/ /-170.12 -48.06/-2.02 7 [bos] grazie had a small . [eos] tgt3: mod/noi/dif/loss/nce/logp -149.86/-13.00 /-136.87/ /-30.71 -7.89 /-0.68 20 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast [eos] tgt4: mod/noi/dif/loss/nce/logp -133.58/-13.08 /-120.50/ /-14.34 -6.68 /-0.65 21 [bos] grazie had the small , slick head and her hair and skin were the color of golden toast . [eos] tgt5: mod/noi/dif/loss/nce/logp -144.63/-13.08 /-131.55/ /-25.39 -6.89 /-0.62 22 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . . [eos] cls0 - sp0 : -47.91 -2.40 21 0.00 [bos] she had a other , streets all and property joined and cleaning its the first of patience cleaning . [eos] cls0 - sp1 : -47.93 -2.40 21 0.00 [bos] she had a other , streets all and i joined and joined its the first of joined cleaning . [eos] cls0 - sp2 : -47.94 -2.40 21 0.00 [bos] she had a other , streets all and property joined and preceding its the first of cleaning bidding . [eos] cls0 - sp3 : -47.94 -2.40 21 0.00 [bos] she had a other , streets all and i joined and preceding its the first of joined cleaning . [eos] cls0 - sp4 : -47.95 -2.40 21 0.00 [bos] she had a other , streets all and property joined and cleaning its the first of cleaning bidding . [eos] cls1 - sp0 : -53.00 -2.65 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning were the first of telephone bidding . [eos] cls1 - sp1 : -53.09 -2.65 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning its the first of telephone bidding . [eos] cls1 - sp2 : -53.30 -2.67 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning were the first of discussed bidding . [eos] cls1 - sp3 : -53.36 -2.67 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning its the first of discussed bidding . [eos] cls1 - sp4 : -53.38 -2.67 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning ! the first of telephone bidding . [eos] cls2 - sp0 : -56.60 -2.83 21 0.70 [bos] she only a later , telephone all and her corner and bidding were the be of telephone telephone . [eos] cls2 - sp1 : -56.87 -2.84 21 0.70 [bos] she only a later , telephone all and her corner and laughed were the be of telephone telephone . [eos] cls2 - sp2 : -56.97 -2.85 21 0.70 [bos] she only a later , telephone all and her corner and bidding were the be of telephone indifferent . [eos] cls2 - sp3 : -57.00 -2.85 21 0.70 [bos] she only a later , telephone all and her corner and laughed were the all of telephone telephone . [eos] cls2 - sp4 : -57.02 -2.85 21 0.70 [bos] she only a were , telephone all and her corner and laughed were the be of telephone telephone . [eos] cls3 - sp0 : -43.16 -2.16 21 1.00 [bos] we only a later , telephone all and her corner and telephone were the be of telephone telephone . [eos] cls3 - sp1 : -43.24 -2.16 21 1.00 [bos] we only a later , telephone all and her corner and agree were the be of telephone telephone . [eos] cls3 - sp2 : -43.38 -2.17 21 1.00 [bos] we only a later , telephone all and her corner and almost were the be of telephone telephone . [eos] cls3 - sp3 : -43.46 -2.17 21 1.00 [bos] we only a later , telephone all and her corner and mississippi were the be of telephone telephone . [eos] cls3 - sp4 : -43.50 -2.18 21 1.00 [bos] we only a later , telephone all and her corner and telephone were the all of telephone telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-241 src: none none 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt0: mod/noi/dif/loss/nce/logp -108.27/-1.99 /-106.28/0.69/-0.69 -5.41 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt1: mod/noi/dif/loss/nce/logp -108.27/-1.99 /-106.28/ /-0.69 -5.41 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt2: mod/noi/dif/loss/nce/logp -284.78/-12.10 /-272.68/ /-167.09 -47.46/-2.02 7 [bos] grazie had a small . [eos] tgt3: mod/noi/dif/loss/nce/logp -153.36/-13.00 /-140.36/ /-34.77 -8.07 /-0.68 20 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast [eos] tgt4: mod/noi/dif/loss/nce/logp -132.58/-13.08 /-119.50/ /-13.91 -6.63 /-0.65 21 [bos] grazie had the small , slick head and her hair and skin were the color of golden toast . [eos] tgt5: mod/noi/dif/loss/nce/logp -143.69/-13.08 /-130.61/ /-25.02 -6.84 /-0.62 22 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . . [eos] cls0 - sp0 : -47.91 -2.40 21 0.00 [bos] she had a other , streets all and property joined and cleaning its the first of patience cleaning . [eos] cls0 - sp1 : -47.93 -2.40 21 0.00 [bos] she had a other , streets all and i joined and joined its the first of joined cleaning . [eos] cls0 - sp2 : -47.94 -2.40 21 0.00 [bos] she had a other , streets all and property joined and preceding its the first of cleaning bidding . [eos] cls0 - sp3 : -47.94 -2.40 21 0.00 [bos] she had a other , streets all and i joined and preceding its the first of joined cleaning . [eos] cls0 - sp4 : -47.95 -2.40 21 0.00 [bos] she had a other , streets all and property joined and cleaning its the first of cleaning bidding . [eos] cls1 - sp0 : -53.00 -2.65 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning were the first of telephone bidding . [eos] cls1 - sp1 : -53.09 -2.65 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning its the first of telephone bidding . [eos] cls1 - sp2 : -53.30 -2.67 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning were the first of discussed bidding . [eos] cls1 - sp3 : -53.36 -2.67 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning its the first of discussed bidding . [eos] cls1 - sp4 : -53.38 -2.67 21 0.25 [bos] don't had a ! , cleaning all and ! discussed and cleaning ! the first of telephone bidding . [eos] cls2 - sp0 : -56.60 -2.83 21 0.70 [bos] she only a later , telephone all and her corner and bidding were the be of telephone telephone . [eos] cls2 - sp1 : -56.87 -2.84 21 0.70 [bos] she only a later , telephone all and her corner and laughed were the be of telephone telephone . [eos] cls2 - sp2 : -56.97 -2.85 21 0.70 [bos] she only a later , telephone all and her corner and bidding were the be of telephone indifferent . [eos] cls2 - sp3 : -57.00 -2.85 21 0.70 [bos] she only a later , telephone all and her corner and laughed were the all of telephone telephone . [eos] cls2 - sp4 : -57.02 -2.85 21 0.70 [bos] she only a were , telephone all and her corner and laughed were the be of telephone telephone . [eos] cls3 - sp0 : -43.16 -2.16 21 1.00 [bos] we only a later , telephone all and her corner and telephone were the be of telephone telephone . [eos] cls3 - sp1 : -43.24 -2.16 21 1.00 [bos] we only a later , telephone all and her corner and agree were the be of telephone telephone . [eos] cls3 - sp2 : -43.38 -2.17 21 1.00 [bos] we only a later , telephone all and her corner and almost were the be of telephone telephone . [eos] cls3 - sp3 : -43.46 -2.17 21 1.00 [bos] we only a later , telephone all and her corner and mississippi were the be of telephone telephone . [eos] cls3 - sp4 : -43.50 -2.18 21 1.00 [bos] we only a later , telephone all and her corner and telephone were the all of telephone telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-242 src: none none 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt0: mod/noi/dif/loss/nce/logp -112.38/-1.99 /-110.39/0.69/-0.69 -5.62 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt1: mod/noi/dif/loss/nce/logp -112.38/-1.99 /-110.39/ /-0.69 -5.62 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt2: mod/noi/dif/loss/nce/logp -275.01/-12.10 /-262.91/ /-153.21 -45.84/-2.02 7 [bos] grazie had a small . [eos] tgt3: mod/noi/dif/loss/nce/logp -150.90/-13.00 /-137.90/ /-28.21 -7.94 /-0.68 20 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast [eos] tgt4: mod/noi/dif/loss/nce/logp -137.84/-13.08 /-124.76/ /-15.06 -6.89 /-0.65 21 [bos] grazie had the small , slick head and her hair and skin were the color of golden toast . [eos] tgt5: mod/noi/dif/loss/nce/logp -147.20/-13.08 /-134.12/ /-24.42 -7.01 /-0.62 22 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . . [eos] cls0 - sp0 : -46.07 -2.30 21 0.00 [bos] she had a later , joined streets and it joined and couldn't were that be of cleaning bidding . [eos] cls0 - sp1 : -46.09 -2.30 21 0.00 [bos] she had a other , joined streets and it joined and couldn't were that be of cleaning bidding . [eos] cls0 - sp2 : -46.14 -2.31 21 0.00 [bos] she had a or , joined streets and it joined and couldn't were that be of cleaning bidding . [eos] cls0 - sp3 : -46.18 -2.31 21 0.00 [bos] she had a later , joined streets and it joined and couldn't were that be of patience bidding . [eos] cls0 - sp4 : -46.22 -2.31 21 0.00 [bos] she had a other , joined streets and it joined and couldn't were that be of patience bidding . [eos] cls1 - sp0 : -52.55 -2.63 21 0.25 [bos] don't had a ! , joined streets and her joined and couldn't were the be of telephone bidding . [eos] cls1 - sp1 : -52.66 -2.63 21 0.25 [bos] don't had a ! , joined couldn't and her joined and couldn't were the be of telephone bidding . [eos] cls1 - sp2 : -52.71 -2.64 21 0.25 [bos] don't had a ! , joined streets and her joined and couldn't were the be of discussed bidding . [eos] cls1 - sp3 : -52.74 -2.64 21 0.25 [bos] don't had a ! , joined couldn't and her joined and couldn't were the be of discussed bidding . [eos] cls1 - sp4 : -52.87 -2.64 21 0.25 [bos] don't had a ! , joined streets and her joined and couldn't were the be of she bidding . [eos] cls2 - sp0 : -52.95 -2.65 21 0.70 [bos] she only a later , corner telephone and her corner and couldn't were the be of telephone telephone . [eos] cls2 - sp1 : -53.07 -2.65 21 0.70 [bos] she only a later , corner telephone and her corner and couldn't were the be of telephone discussed . [eos] cls2 - sp2 : -53.18 -2.66 21 0.60 [bos] she only a later , corner telephone and her corner and couldn't were the be of telephone bidding . [eos] cls2 - sp3 : -53.42 -2.67 21 0.70 [bos] she only a later , corner telephone and her telephone and couldn't were the be of telephone telephone . [eos] cls2 - sp4 : -53.54 -2.68 21 0.70 [bos] she only a later , corner telephone and her don't and couldn't were the be of telephone telephone . [eos] cls3 - sp0 : -41.77 -2.09 21 1.00 [bos] she had a later , corner telephone and her we and first were the be of telephone telephone . [eos] cls3 - sp1 : -41.83 -2.09 21 1.00 [bos] she had a later , corner telephone and her corner and first were the be of telephone telephone . [eos] cls3 - sp2 : -41.86 -2.09 21 1.00 [bos] we only a later , corner telephone and her we and first were the be of telephone telephone . [eos] cls3 - sp3 : -41.87 -2.09 21 1.00 [bos] she had a later , corner telephone and her telephone and first were the be of telephone telephone . [eos] cls3 - sp4 : -41.88 -2.09 21 1.00 [bos] she had a later , corner telephone and her corner and don't were the be of telephone telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-243 src: none none 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt0: mod/noi/dif/loss/nce/logp -109.34/-1.99 /-107.36/0.69/-0.69 -5.47 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt1: mod/noi/dif/loss/nce/logp -109.34/-1.99 /-107.36/ /-0.69 -5.47 /-0.10 21 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . [eos] tgt2: mod/noi/dif/loss/nce/logp -273.44/-12.10 /-261.34/ /-154.68 -45.57/-2.02 7 [bos] grazie had a small . [eos] tgt3: mod/noi/dif/loss/nce/logp -151.64/-13.00 /-138.64/ /-31.98 -7.98 /-0.68 20 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast [eos] tgt4: mod/noi/dif/loss/nce/logp -134.71/-13.08 /-121.63/ /-14.96 -6.74 /-0.65 21 [bos] grazie had the small , slick head and her hair and skin were the color of golden toast . [eos] tgt5: mod/noi/dif/loss/nce/logp -143.97/-13.08 /-130.88/ /-24.22 -6.86 /-0.62 22 [bos] grazie had a small , slick head and her hair and skin were the color of golden toast . . [eos] cls0 - sp0 : -46.07 -2.30 21 0.00 [bos] she had a later , joined streets and it joined and couldn't were that be of cleaning bidding . [eos] cls0 - sp1 : -46.09 -2.30 21 0.00 [bos] she had a other , joined streets and it joined and couldn't were that be of cleaning bidding . [eos] cls0 - sp2 : -46.14 -2.31 21 0.00 [bos] she had a or , joined streets and it joined and couldn't were that be of cleaning bidding . [eos] cls0 - sp3 : -46.18 -2.31 21 0.00 [bos] she had a later , joined streets and it joined and couldn't were that be of patience bidding . [eos] cls0 - sp4 : -46.22 -2.31 21 0.00 [bos] she had a other , joined streets and it joined and couldn't were that be of patience bidding . [eos] cls1 - sp0 : -52.55 -2.63 21 0.25 [bos] don't had a ! , joined streets and her joined and couldn't were the be of telephone bidding . [eos] cls1 - sp1 : -52.66 -2.63 21 0.25 [bos] don't had a ! , joined couldn't and her joined and couldn't were the be of telephone bidding . [eos] cls1 - sp2 : -52.71 -2.64 21 0.25 [bos] don't had a ! , joined streets and her joined and couldn't were the be of discussed bidding . [eos] cls1 - sp3 : -52.74 -2.64 21 0.25 [bos] don't had a ! , joined couldn't and her joined and couldn't were the be of discussed bidding . [eos] cls1 - sp4 : -52.87 -2.64 21 0.25 [bos] don't had a ! , joined streets and her joined and couldn't were the be of she bidding . [eos] cls2 - sp0 : -52.95 -2.65 21 0.70 [bos] she only a later , corner telephone and her corner and couldn't were the be of telephone telephone . [eos] cls2 - sp1 : -53.07 -2.65 21 0.70 [bos] she only a later , corner telephone and her corner and couldn't were the be of telephone discussed . [eos] cls2 - sp2 : -53.18 -2.66 21 0.60 [bos] she only a later , corner telephone and her corner and couldn't were the be of telephone bidding . [eos] cls2 - sp3 : -53.42 -2.67 21 0.70 [bos] she only a later , corner telephone and her telephone and couldn't were the be of telephone telephone . [eos] cls2 - sp4 : -53.54 -2.68 21 0.70 [bos] she only a later , corner telephone and her don't and couldn't were the be of telephone telephone . [eos] cls3 - sp0 : -41.77 -2.09 21 1.00 [bos] she had a later , corner telephone and her we and first were the be of telephone telephone . [eos] cls3 - sp1 : -41.83 -2.09 21 1.00 [bos] she had a later , corner telephone and her corner and first were the be of telephone telephone . [eos] cls3 - sp2 : -41.86 -2.09 21 1.00 [bos] we only a later , corner telephone and her we and first were the be of telephone telephone . [eos] cls3 - sp3 : -41.87 -2.09 21 1.00 [bos] she had a later , corner telephone and her telephone and first were the be of telephone telephone . [eos] cls3 - sp4 : -41.88 -2.09 21 1.00 [bos] she had a later , corner telephone and her corner and don't were the be of telephone telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-244 src: none none 5 [bos] pioneers ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -21.24 /-0.38 /-20.87 /15.81/-15.81 -5.31 /-0.09 5 [bos] pioneers ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -21.24 /-0.38 /-20.87 / /-15.81 -5.31 /-0.09 5 [bos] pioneers ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -42.34 /-10.50 /-31.85 / /-26.79 -14.11/-3.50 4 [bos] pioneers ! [eos] tgt3: mod/noi/dif/loss/nce/logp -53.44 /-11.60 /-41.84 / /-36.78 -10.69/-2.32 6 [bos] pioneers ! ! . [eos] tgt4: mod/noi/dif/loss/nce/logp -18.17 /-13.11 /-5.06 / /-0.00 -4.54 /-3.28 5 [bos] digby ! ! [eos] tgt5: mod/noi/dif/loss/nce/logp -37.32 /-11.31 /-26.01 / /-20.96 -9.33 /-2.83 5 [bos] pioneers ! '' [eos] cls0 - sp0 : -6.21 -1.55 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -7.18 -1.80 5 0.00 [bos] she ! ! [eos] cls0 - sp2 : -7.23 -1.81 5 0.00 [bos] 7 ! ! [eos] cls0 - sp3 : -7.49 -1.87 5 0.00 [bos] no ! ! [eos] cls0 - sp4 : -7.64 -1.91 5 0.00 [bos] couldn't ! ! [eos] cls1 - sp0 : -5.79 -1.45 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -5.96 -1.49 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -6.19 -1.55 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -7.08 -1.77 5 0.25 [bos] 7 ! ! [eos] cls1 - sp4 : -7.41 -1.85 5 0.25 [bos] she ! ! [eos] cls2 - sp0 : -5.24 -1.31 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -5.30 -1.32 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -5.55 -1.39 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -6.74 -1.69 5 0.50 [bos] 7 ! ! [eos] cls2 - sp4 : -6.84 -1.71 5 0.50 [bos] no ! ! [eos] cls3 - sp0 : -4.40 -1.10 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -5.82 -1.46 5 0.75 [bos] 7 ! ! [eos] cls3 - sp2 : -6.02 -1.51 5 0.75 [bos] no ! ! [eos] cls3 - sp3 : -6.10 -1.53 5 0.75 [bos] we ! ! [eos] cls3 - sp4 : -6.28 -1.57 5 0.75 [bos] don't ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-245 src: none none 5 [bos] pioneers ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -23.17 /-0.38 /-22.80 /15.28/-15.28 -5.79 /-0.09 5 [bos] pioneers ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -23.17 /-0.38 /-22.80 / /-15.28 -5.79 /-0.09 5 [bos] pioneers ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -47.86 /-10.50 /-37.36 / /-29.84 -15.95/-3.50 4 [bos] pioneers ! [eos] tgt3: mod/noi/dif/loss/nce/logp -52.99 /-11.60 /-41.39 / /-33.87 -10.60/-2.32 6 [bos] pioneers ! ! . [eos] tgt4: mod/noi/dif/loss/nce/logp -20.63 /-13.11 /-7.51 / /-0.00 -5.16 /-3.28 5 [bos] digby ! ! [eos] tgt5: mod/noi/dif/loss/nce/logp -40.71 /-11.31 /-29.40 / /-21.88 -10.18/-2.83 5 [bos] pioneers ! '' [eos] cls0 - sp0 : -6.21 -1.55 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -7.18 -1.80 5 0.00 [bos] she ! ! [eos] cls0 - sp2 : -7.23 -1.81 5 0.00 [bos] 7 ! ! [eos] cls0 - sp3 : -7.49 -1.87 5 0.00 [bos] no ! ! [eos] cls0 - sp4 : -7.64 -1.91 5 0.00 [bos] couldn't ! ! [eos] cls1 - sp0 : -5.79 -1.45 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -5.96 -1.49 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -6.19 -1.55 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -7.08 -1.77 5 0.25 [bos] 7 ! ! [eos] cls1 - sp4 : -7.41 -1.85 5 0.25 [bos] she ! ! [eos] cls2 - sp0 : -5.24 -1.31 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -5.30 -1.32 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -5.55 -1.39 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -6.74 -1.69 5 0.50 [bos] 7 ! ! [eos] cls2 - sp4 : -6.84 -1.71 5 0.50 [bos] no ! ! [eos] cls3 - sp0 : -4.40 -1.10 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -5.82 -1.46 5 0.75 [bos] 7 ! ! [eos] cls3 - sp2 : -6.02 -1.51 5 0.75 [bos] no ! ! [eos] cls3 - sp3 : -6.10 -1.53 5 0.75 [bos] we ! ! [eos] cls3 - sp4 : -6.28 -1.57 5 0.75 [bos] don't ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-246 src: none none 5 [bos] pioneers ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -20.29 /-0.38 /-19.92 /14.98/-14.98 -5.07 /-0.09 5 [bos] pioneers ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -20.29 /-0.38 /-19.92 / /-14.98 -5.07 /-0.09 5 [bos] pioneers ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -39.20 /-10.50 /-28.70 / /-23.76 -13.07/-3.50 4 [bos] pioneers ! [eos] tgt3: mod/noi/dif/loss/nce/logp -52.97 /-11.60 /-41.36 / /-36.42 -10.59/-2.32 6 [bos] pioneers ! ! . [eos] tgt4: mod/noi/dif/loss/nce/logp -18.05 /-13.11 /-4.94 / /-0.00 -4.51 /-3.28 5 [bos] digby ! ! [eos] tgt5: mod/noi/dif/loss/nce/logp -36.31 /-11.31 /-25.00 / /-20.06 -9.08 /-2.83 5 [bos] pioneers ! '' [eos] cls0 - sp0 : -6.27 -1.57 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -6.75 -1.69 5 0.00 [bos] ) ! ! [eos] cls0 - sp2 : -7.12 -1.78 5 0.00 [bos] 7 ! ! [eos] cls0 - sp3 : -7.15 -1.79 5 0.00 [bos] no ! ! [eos] cls0 - sp4 : -7.64 -1.91 5 0.00 [bos] she ! ! [eos] cls1 - sp0 : -5.85 -1.46 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -5.93 -1.48 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -6.20 -1.55 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -6.58 -1.64 5 0.25 [bos] ) ! ! [eos] cls1 - sp4 : -6.89 -1.72 5 0.25 [bos] 7 ! ! [eos] cls2 - sp0 : -5.28 -1.32 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -5.29 -1.32 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -5.45 -1.36 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -6.46 -1.62 5 0.50 [bos] ) ! ! [eos] cls2 - sp4 : -6.65 -1.66 5 0.50 [bos] 7 ! ! [eos] cls3 - sp0 : -4.35 -1.09 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -5.59 -1.40 5 0.75 [bos] 7 ! ! [eos] cls3 - sp2 : -5.77 -1.44 5 0.75 [bos] no ! ! [eos] cls3 - sp3 : -6.33 -1.58 5 0.75 [bos] ) ! ! [eos] cls3 - sp4 : -6.35 -1.59 5 0.75 [bos] we ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-247 src: none none 5 [bos] pioneers ! ! [eos] tgt0: mod/noi/dif/loss/nce/logp -21.85 /-0.38 /-21.47 /14.79/-14.79 -5.46 /-0.09 5 [bos] pioneers ! ! [eos] tgt1: mod/noi/dif/loss/nce/logp -21.85 /-0.38 /-21.47 / /-14.79 -5.46 /-0.09 5 [bos] pioneers ! ! [eos] tgt2: mod/noi/dif/loss/nce/logp -43.69 /-10.50 /-33.19 / /-26.51 -14.56/-3.50 4 [bos] pioneers ! [eos] tgt3: mod/noi/dif/loss/nce/logp -52.45 /-11.60 /-40.85 / /-34.17 -10.49/-2.32 6 [bos] pioneers ! ! . [eos] tgt4: mod/noi/dif/loss/nce/logp -19.80 /-13.11 /-6.68 / /-0.00 -4.95 /-3.28 5 [bos] digby ! ! [eos] tgt5: mod/noi/dif/loss/nce/logp -39.40 /-11.31 /-28.09 / /-21.41 -9.85 /-2.83 5 [bos] pioneers ! '' [eos] cls0 - sp0 : -6.27 -1.57 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -6.75 -1.69 5 0.00 [bos] ) ! ! [eos] cls0 - sp2 : -7.12 -1.78 5 0.00 [bos] 7 ! ! [eos] cls0 - sp3 : -7.15 -1.79 5 0.00 [bos] no ! ! [eos] cls0 - sp4 : -7.64 -1.91 5 0.00 [bos] she ! ! [eos] cls1 - sp0 : -5.85 -1.46 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -5.93 -1.48 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -6.20 -1.55 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -6.58 -1.64 5 0.25 [bos] ) ! ! [eos] cls1 - sp4 : -6.89 -1.72 5 0.25 [bos] 7 ! ! [eos] cls2 - sp0 : -5.28 -1.32 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -5.29 -1.32 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -5.45 -1.36 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -6.46 -1.62 5 0.50 [bos] ) ! ! [eos] cls2 - sp4 : -6.65 -1.66 5 0.50 [bos] 7 ! ! [eos] cls3 - sp0 : -4.35 -1.09 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -5.59 -1.40 5 0.75 [bos] 7 ! ! [eos] cls3 - sp2 : -5.77 -1.44 5 0.75 [bos] no ! ! [eos] cls3 - sp3 : -6.33 -1.58 5 0.75 [bos] ) ! ! [eos] cls3 - sp4 : -6.35 -1.59 5 0.75 [bos] we ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-248 src: none none 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.06 /-2.38 /-68.68 /0.69/-0.69 -3.38 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.06 /-2.38 /-68.68 / /-0.69 -3.38 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -197.15/-12.32 /-184.83/ /-116.84 -98.58/-6.16 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -112.28/-13.28 /-99.00 / /-31.01 -5.61 /-0.66 21 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -92.74 /-13.37 /-79.36 / /-11.37 -4.42 /-0.64 22 [bos] it was then that i [unk] myself of the rights of the citizen and declared the income tax [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -91.40 /-13.48 /-77.91 / /-9.92 -4.35 /-0.64 22 [bos] the was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] cls0 - sp0 : -32.51 -1.55 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and first the joined deck [unk] . [eos] cls0 - sp1 : -32.54 -1.55 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and first the no deck [unk] . [eos] cls0 - sp2 : -32.77 -1.56 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and all the joined deck [unk] . [eos] cls0 - sp3 : -32.80 -1.56 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and all the no deck [unk] . [eos] cls0 - sp4 : -32.87 -1.57 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and united the no deck [unk] . [eos] cls1 - sp0 : -34.43 -1.91 19 0.28 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls1 - sp1 : -34.89 -1.94 19 0.33 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls1 - sp2 : -35.11 -1.95 19 0.28 [bos] ! was has that i [unk] she of the skies of a 7 and ! the ! [eos] cls1 - sp3 : -38.39 -2.13 19 0.33 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls1 - sp4 : -38.84 -2.16 19 0.39 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls2 - sp0 : -42.80 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the made streets [unk] . [eos] cls2 - sp1 : -42.88 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the ! ! [unk] . [eos] cls2 - sp2 : -42.92 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the corner telephone [unk] . [eos] cls2 - sp3 : -42.92 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the telephone streets [unk] . [eos] cls2 - sp4 : -42.96 -2.05 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the made state [unk] . [eos] cls3 - sp0 : -36.05 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the made streets [unk] . [eos] cls3 - sp1 : -36.13 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the made state [unk] . [eos] cls3 - sp2 : -36.13 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the corner streets [unk] . [eos] cls3 - sp3 : -36.15 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the corner telephone [unk] . [eos] cls3 - sp4 : -36.24 -1.73 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the made telephone [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-249 src: none none 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.78 /-2.38 /-69.40 /0.69/-0.69 -3.42 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.78 /-2.38 /-69.40 / /-0.69 -3.42 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -197.11/-12.32 /-184.79/ /-116.09 -98.56/-6.16 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -116.56/-13.28 /-103.28/ /-34.57 -5.83 /-0.66 21 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -94.32 /-13.37 /-80.94 / /-12.24 -4.49 /-0.64 22 [bos] it was then that i [unk] myself of the rights of the citizen and declared the income tax [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -92.76 /-13.48 /-79.27 / /-10.57 -4.42 /-0.64 22 [bos] the was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] cls0 - sp0 : -32.51 -1.55 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and first the joined deck [unk] . [eos] cls0 - sp1 : -32.54 -1.55 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and first the no deck [unk] . [eos] cls0 - sp2 : -32.77 -1.56 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and all the joined deck [unk] . [eos] cls0 - sp3 : -32.80 -1.56 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and all the no deck [unk] . [eos] cls0 - sp4 : -32.87 -1.57 22 0.00 [bos] it was has that i [unk] all of the cleaning of a streets and united the no deck [unk] . [eos] cls1 - sp0 : -34.43 -1.91 19 0.28 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls1 - sp1 : -34.89 -1.94 19 0.33 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls1 - sp2 : -35.11 -1.95 19 0.28 [bos] ! was has that i [unk] she of the skies of a 7 and ! the ! [eos] cls1 - sp3 : -38.39 -2.13 19 0.33 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls1 - sp4 : -38.84 -2.16 19 0.39 [bos] ! was has that i [unk] she of the cleaning of a 7 and ! the ! [eos] cls2 - sp0 : -42.80 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the made streets [unk] . [eos] cls2 - sp1 : -42.88 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the ! ! [unk] . [eos] cls2 - sp2 : -42.92 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the corner telephone [unk] . [eos] cls2 - sp3 : -42.92 -2.04 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the telephone streets [unk] . [eos] cls2 - sp4 : -42.96 -2.05 22 0.67 [bos] ! was has that i [unk] she of the indifferent of a telephone and ! the made state [unk] . [eos] cls3 - sp0 : -36.05 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the made streets [unk] . [eos] cls3 - sp1 : -36.13 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the made state [unk] . [eos] cls3 - sp2 : -36.13 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the corner streets [unk] . [eos] cls3 - sp3 : -36.15 -1.72 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the corner telephone [unk] . [eos] cls3 - sp4 : -36.24 -1.73 22 1.00 [bos] we was has that i [unk] all of the telephone of a telephone and all the made telephone [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-250 src: none none 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.90 /-2.38 /-70.52 /0.69/-0.69 -3.47 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.90 /-2.38 /-70.52 / /-0.69 -3.47 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -169.07/-12.32 /-156.75/ /-86.93 -84.53/-6.16 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -111.19/-13.28 /-97.91 / /-28.08 -5.56 /-0.66 21 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -94.49 /-13.37 /-81.11 / /-11.29 -4.50 /-0.64 22 [bos] it was then that i [unk] myself of the rights of the citizen and declared the income tax [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -93.28 /-13.48 /-79.80 / /-9.98 -4.44 /-0.64 22 [bos] the was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] cls0 - sp0 : -32.46 -1.80 19 0.06 [bos] it was has that i [unk] all of the streets of a cleaning and be the joined [eos] cls0 - sp1 : -32.62 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the later dr. [unk] . [eos] cls0 - sp2 : -32.62 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the joined uniforms [unk] . [eos] cls0 - sp3 : -32.63 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the later uniforms [unk] . [eos] cls0 - sp4 : -32.64 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the later beard [unk] . [eos] cls1 - sp0 : -34.99 -1.94 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a cleaning and all the 7 [eos] cls1 - sp1 : -35.21 -1.96 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a cleaning and made the 7 [eos] cls1 - sp2 : -35.28 -1.96 19 0.28 [bos] it was has that i [unk] all of the couldn't of a cleaning and all the 7 [eos] cls1 - sp3 : -35.30 -1.96 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a editor and all the 7 [eos] cls1 - sp4 : -35.44 -1.97 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a cleaning and all the don't [eos] cls2 - sp0 : -38.78 -2.15 19 0.61 [bos] ! was has that i [unk] all of the corner of a telephone and made the couldn't [eos] cls2 - sp1 : -40.14 -2.23 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the couldn't [eos] cls2 - sp2 : -41.85 -2.33 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the later [eos] cls2 - sp3 : -41.97 -2.33 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the don't [eos] cls2 - sp4 : -42.35 -2.35 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the personal [eos] cls3 - sp0 : -32.42 -1.54 22 1.00 [bos] we was later that i [unk] all of the united of a telephone and made the personal streets [unk] . [eos] cls3 - sp1 : -32.56 -1.55 22 1.00 [bos] we was has that i [unk] all of the united of a telephone and made the personal streets [unk] . [eos] cls3 - sp2 : -32.61 -1.55 22 1.00 [bos] we was later that i [unk] all of the corner of a telephone and made the personal streets [unk] . [eos] cls3 - sp3 : -32.66 -1.56 22 1.00 [bos] we was later that i [unk] all of the united of a telephone and made the situation streets [unk] . [eos] cls3 - sp4 : -32.67 -1.56 22 1.00 [bos] we was later that i [unk] all of the telephone of a telephone and made the personal streets [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-251 src: none none 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -72.54 /-2.38 /-70.16 /0.69/-0.69 -3.45 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -72.54 /-2.38 /-70.16 / /-0.69 -3.45 /-0.11 22 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -166.17/-12.32 /-153.85/ /-84.39 -83.09/-6.16 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -115.31/-13.28 /-102.03/ /-32.56 -5.77 /-0.66 21 [bos] it was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -95.68 /-13.37 /-82.31 / /-12.85 -4.56 /-0.64 22 [bos] it was then that i [unk] myself of the rights of the citizen and declared the income tax [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -93.86 /-13.48 /-80.38 / /-10.92 -4.47 /-0.64 22 [bos] the was then that i [unk] myself of the rights of a citizen and declared the income tax [unk] . [eos] cls0 - sp0 : -32.46 -1.80 19 0.06 [bos] it was has that i [unk] all of the streets of a cleaning and be the joined [eos] cls0 - sp1 : -32.62 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the later dr. [unk] . [eos] cls0 - sp2 : -32.62 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the joined uniforms [unk] . [eos] cls0 - sp3 : -32.63 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the later uniforms [unk] . [eos] cls0 - sp4 : -32.64 -1.55 22 0.00 [bos] it was has that i [unk] all of the streets of a cleaning and all the later beard [unk] . [eos] cls1 - sp0 : -34.99 -1.94 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a cleaning and all the 7 [eos] cls1 - sp1 : -35.21 -1.96 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a cleaning and made the 7 [eos] cls1 - sp2 : -35.28 -1.96 19 0.28 [bos] it was has that i [unk] all of the couldn't of a cleaning and all the 7 [eos] cls1 - sp3 : -35.30 -1.96 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a editor and all the 7 [eos] cls1 - sp4 : -35.44 -1.97 19 0.28 [bos] ! was has that i [unk] all of the couldn't of a cleaning and all the don't [eos] cls2 - sp0 : -38.78 -2.15 19 0.61 [bos] ! was has that i [unk] all of the corner of a telephone and made the couldn't [eos] cls2 - sp1 : -40.14 -2.23 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the couldn't [eos] cls2 - sp2 : -41.85 -2.33 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the later [eos] cls2 - sp3 : -41.97 -2.33 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the don't [eos] cls2 - sp4 : -42.35 -2.35 19 0.67 [bos] ! was has that i [unk] all of the corner of a telephone and made the personal [eos] cls3 - sp0 : -32.42 -1.54 22 1.00 [bos] we was later that i [unk] all of the united of a telephone and made the personal streets [unk] . [eos] cls3 - sp1 : -32.56 -1.55 22 1.00 [bos] we was has that i [unk] all of the united of a telephone and made the personal streets [unk] . [eos] cls3 - sp2 : -32.61 -1.55 22 1.00 [bos] we was later that i [unk] all of the corner of a telephone and made the personal streets [unk] . [eos] cls3 - sp3 : -32.66 -1.56 22 1.00 [bos] we was later that i [unk] all of the united of a telephone and made the situation streets [unk] . [eos] cls3 - sp4 : -32.67 -1.56 22 1.00 [bos] we was later that i [unk] all of the telephone of a telephone and made the personal streets [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-252 src: none none 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt0: mod/noi/dif/loss/nce/logp -236.53/-6.83 /-229.70/2.75/-2.75 -3.70 /-0.11 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt1: mod/noi/dif/loss/nce/logp -314.66/-19.51 /-295.15/ /-68.20 -5.33 /-0.33 60 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had [eos] tgt2: mod/noi/dif/loss/nce/logp -239.27/-12.25 /-227.02/ /-0.07 -39.88/-2.04 7 [bos] never a `` quick study [eos] tgt3: mod/noi/dif/loss/nce/logp -310.19/-11.71 /-298.48/ /-71.54 -44.31/-1.67 8 [bos] never a `` quick study . [eos] tgt4: mod/noi/dif/loss/nce/logp -316.39/-12.37 /-304.03/ /-77.08 -39.55/-1.55 9 [bos] never a `` quick study '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -264.21/-12.68 /-251.52/ /-24.58 -20.32/-0.98 14 [bos] never a `` quick study '' , he now made no attempt [eos] cls0 - sp0 : -107.20 -1.68 65 0.06 [bos] '' a '' were and is , if this made no on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was were states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp1 : -107.20 -1.68 65 0.06 [bos] '' a '' were and is , if this made no on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was world states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp2 : -107.22 -1.68 65 0.06 [bos] '' a '' were and is , if this made any on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was world states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp3 : -107.22 -1.68 65 0.06 [bos] '' a '' were and is , if this made no on to preceding his `` activity '' and they a preceding of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was world states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp4 : -107.23 -1.68 65 0.06 [bos] '' a '' were and is , if this made any on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was were states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls1 - sp0 : -117.73 -2.40 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i preceding [unk] -- was were may , preceding , and [eos] cls1 - sp1 : -117.86 -2.41 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i streets [unk] -- was were may , preceding , and [eos] cls1 - sp2 : -117.98 -2.41 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i governor's [unk] -- was were may , preceding , and [eos] cls1 - sp3 : -118.03 -2.41 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i deck [unk] -- was were may , preceding , and [eos] cls1 - sp4 : -141.41 -2.21 65 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i preceding [unk] -- was were may , preceding , and names because may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls2 - sp0 : -174.53 -2.73 65 0.73 [bos] '' a `` were and is , he her made no who to streets his `` per '' and they a [unk] of gloomy was [unk] , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp1 : -174.61 -2.73 65 0.73 [bos] '' a `` were and is , he her made no who to streets his `` center '' and they a [unk] of gloomy was people , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp2 : -174.62 -2.73 65 0.73 [bos] '' a `` were and is , he her made no on to streets his `` center '' and they a [unk] of gloomy was people , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp3 : -174.62 -2.73 65 0.73 [bos] '' a `` were and is , he her made no who to streets his `` per '' and they a [unk] of gloomy was [unk] , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` per [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp4 : -174.68 -2.73 65 0.73 [bos] '' a `` were and is , it her made no on to streets his `` per '' and they a [unk] of gloomy was [unk] , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls3 - sp0 : -135.27 -2.05 67 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` state [unk] [unk] and `` [unk] '' and this of his the '' and . [eos] cls3 - sp1 : -135.72 -2.06 67 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` other [unk] [unk] and `` [unk] '' and this of his the '' and . [eos] cls3 - sp2 : -142.01 -2.06 70 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` state [unk] [unk] and `` [unk] '' and this of his the '' and . is and . [eos] cls3 - sp3 : -142.15 -2.06 70 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` other [unk] [unk] and `` [unk] '' and this of his the '' and . is and . [eos] cls3 - sp4 : -142.25 -2.06 70 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` state [unk] [unk] and `` [unk] '' and this of his the '' and . is [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-253 src: none none 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt0: mod/noi/dif/loss/nce/logp -237.69/-6.83 /-230.86/6.11/-6.11 -3.71 /-0.11 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt1: mod/noi/dif/loss/nce/logp -317.39/-19.51 /-297.88/ /-73.13 -5.38 /-0.33 60 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had [eos] tgt2: mod/noi/dif/loss/nce/logp -237.00/-12.25 /-224.75/ /-0.00 -39.50/-2.04 7 [bos] never a `` quick study [eos] tgt3: mod/noi/dif/loss/nce/logp -310.19/-11.71 /-298.49/ /-73.74 -44.31/-1.67 8 [bos] never a `` quick study . [eos] tgt4: mod/noi/dif/loss/nce/logp -312.80/-12.37 /-300.43/ /-75.68 -39.10/-1.55 9 [bos] never a `` quick study '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -260.30/-12.68 /-247.62/ /-22.87 -20.02/-0.98 14 [bos] never a `` quick study '' , he now made no attempt [eos] cls0 - sp0 : -107.20 -1.68 65 0.06 [bos] '' a '' were and is , if this made no on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was were states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp1 : -107.20 -1.68 65 0.06 [bos] '' a '' were and is , if this made no on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was world states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp2 : -107.22 -1.68 65 0.06 [bos] '' a '' were and is , if this made any on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was world states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp3 : -107.22 -1.68 65 0.06 [bos] '' a '' were and is , if this made no on to preceding his `` activity '' and they a preceding of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was world states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls0 - sp4 : -107.23 -1.68 65 0.06 [bos] '' a '' were and is , if this made any on to preceding his `` activity '' and they a skywave of streets was preceding , than a men -- . is as than as a i preceding [unk] -- was were states , preceding , and . is may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls1 - sp0 : -117.73 -2.40 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i preceding [unk] -- was were may , preceding , and [eos] cls1 - sp1 : -117.86 -2.41 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i streets [unk] -- was were may , preceding , and [eos] cls1 - sp2 : -117.98 -2.41 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i governor's [unk] -- was were may , preceding , and [eos] cls1 - sp3 : -118.03 -2.41 50 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i deck [unk] -- was were may , preceding , and [eos] cls1 - sp4 : -141.41 -2.21 65 0.27 [bos] '' a `` were and is , it i made no who to minds his `` may '' and they a stevie of streets was stevie , than a between -- . is as than as a i preceding [unk] -- was were may , preceding , and names because may [unk] [unk] and `` [unk] '' had this . is . is [eos] cls2 - sp0 : -174.53 -2.73 65 0.73 [bos] '' a `` were and is , he her made no who to streets his `` per '' and they a [unk] of gloomy was [unk] , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp1 : -174.61 -2.73 65 0.73 [bos] '' a `` were and is , he her made no who to streets his `` center '' and they a [unk] of gloomy was people , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp2 : -174.62 -2.73 65 0.73 [bos] '' a `` were and is , he her made no on to streets his `` center '' and they a [unk] of gloomy was people , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp3 : -174.62 -2.73 65 0.73 [bos] '' a `` were and is , he her made no who to streets his `` per '' and they a [unk] of gloomy was [unk] , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` per [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls2 - sp4 : -174.68 -2.73 65 0.73 [bos] '' a `` were and is , it her made no on to streets his `` per '' and they a [unk] of gloomy was [unk] , than a people -- gloomy people as than as a i people [unk] -- was were gloomy , [unk] , names the `` other [unk] [unk] and `` [unk] '' and this gloomy his the '' [eos] cls3 - sp0 : -135.27 -2.05 67 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` state [unk] [unk] and `` [unk] '' and this of his the '' and . [eos] cls3 - sp1 : -135.72 -2.06 67 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` other [unk] [unk] and `` [unk] '' and this of his the '' and . [eos] cls3 - sp2 : -142.01 -2.06 70 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` state [unk] [unk] and `` [unk] '' and this of his the '' and . is and . [eos] cls3 - sp3 : -142.15 -2.06 70 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` other [unk] [unk] and `` [unk] '' and this of his the '' and . is and . [eos] cls3 - sp4 : -142.25 -2.06 70 1.00 [bos] : a `` were and is , he before made no , to state his `` state '' and they a [unk] of streets was state , they a people -- center people as many as a i people [unk] -- was a state , [unk] , and the `` state [unk] [unk] and `` [unk] '' and this of his the '' and . is [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-254 src: none none 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt0: mod/noi/dif/loss/nce/logp -236.31/-6.83 /-229.47/1.59/-1.59 -3.69 /-0.11 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt1: mod/noi/dif/loss/nce/logp -322.73/-19.51 /-303.22/ /-75.33 -5.47 /-0.33 60 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had [eos] tgt2: mod/noi/dif/loss/nce/logp -240.36/-12.25 /-228.11/ /-0.23 -40.06/-2.04 7 [bos] never a `` quick study [eos] tgt3: mod/noi/dif/loss/nce/logp -313.43/-11.71 /-301.73/ /-73.84 -44.78/-1.67 8 [bos] never a `` quick study . [eos] tgt4: mod/noi/dif/loss/nce/logp -319.06/-12.37 /-306.69/ /-78.80 -39.88/-1.55 9 [bos] never a `` quick study '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -261.70/-12.68 /-249.02/ /-21.13 -20.13/-0.98 14 [bos] never a `` quick study '' , he now made no attempt [eos] cls0 - sp0 : -115.75 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i society [unk] -- was preceding government , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp1 : -115.77 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i society [unk] -- was preceding government , states , government states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp2 : -115.78 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i shall [unk] -- was preceding government , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp3 : -115.83 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as than as a i society [unk] -- was preceding government , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp4 : -115.91 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i society [unk] -- was preceding states , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls1 - sp0 : -150.17 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding within , general , and than one were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp1 : -150.29 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding within , general , and than two were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp2 : -150.29 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was stevie , they a preceding -- were deeds as they as a i . is -- was preceding within , general , and than two were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp3 : -150.37 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding may , general , and than one were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp4 : -150.46 -2.25 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding may , general , and than two were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls2 - sp0 : -168.78 -2.56 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his him '' '' . [eos] cls2 - sp1 : -169.52 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had has gloomy his him '' '' . [eos] cls2 - sp2 : -169.61 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his `` '' '' . [eos] cls2 - sp3 : -169.92 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his him [unk] '' . [eos] cls2 - sp4 : -169.92 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his him '' [unk] . [eos] cls3 - sp0 : -126.77 -1.98 65 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` streets [unk] [unk] and `` [unk] '' had has of his him . [eos] cls3 - sp1 : -127.43 -1.93 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` come [unk] [unk] and `` [unk] '' had has of his him '' [unk] . [eos] cls3 - sp2 : -127.53 -1.93 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` streets [unk] [unk] and `` [unk] '' had has of his him '' [unk] . [eos] cls3 - sp3 : -128.03 -1.94 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` come [unk] [unk] and `` [unk] '' had has of his `` '' [unk] . [eos] cls3 - sp4 : -128.21 -1.94 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` come [unk] [unk] and `` [unk] '' had has of his one and [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-255 src: none none 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt0: mod/noi/dif/loss/nce/logp -237.83/-6.83 /-230.99/5.31/-5.31 -3.72 /-0.11 65 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had never learned his part . [eos] tgt1: mod/noi/dif/loss/nce/logp -320.84/-19.51 /-301.32/ /-75.63 -5.44 /-0.33 60 [bos] never a `` quick study '' , he now made no attempt to learn his `` lines '' and many a mile of film was wasted , many a scene -- sometimes involving as many as a thousand fellow [unk] -- was taken thirty , forty , fifty times because miss [unk] [unk] and `` [unk] '' had [eos] tgt2: mod/noi/dif/loss/nce/logp -237.95/-12.25 /-225.69/ /-0.00 -39.66/-2.04 7 [bos] never a `` quick study [eos] tgt3: mod/noi/dif/loss/nce/logp -313.68/-11.71 /-301.98/ /-76.29 -44.81/-1.67 8 [bos] never a `` quick study . [eos] tgt4: mod/noi/dif/loss/nce/logp -316.13/-12.37 /-303.77/ /-78.08 -39.52/-1.55 9 [bos] never a `` quick study '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -256.25/-12.68 /-243.57/ /-17.88 -19.71/-0.98 14 [bos] never a `` quick study '' , he now made no attempt [eos] cls0 - sp0 : -115.75 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i society [unk] -- was preceding government , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp1 : -115.77 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i society [unk] -- was preceding government , states , government states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp2 : -115.78 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i shall [unk] -- was preceding government , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp3 : -115.83 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as than as a i society [unk] -- was preceding government , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls0 - sp4 : -115.91 -1.81 65 0.00 [bos] : a '' were and is , he other made no on to states his `` streets '' and they a government of on was preceding , they a preceding -- than preceding as they as a i society [unk] -- was preceding states , states , and states two states [unk] [unk] and `` [unk] '' had has ) his ( . [eos] cls1 - sp0 : -150.17 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding within , general , and than one were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp1 : -150.29 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding within , general , and than two were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp2 : -150.29 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was stevie , they a preceding -- were deeds as they as a i . is -- was preceding within , general , and than two were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp3 : -150.37 -2.24 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding may , general , and than one were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls1 - sp4 : -150.46 -2.25 68 0.25 [bos] : a : and and is , he other made no on to were his `` `` '' and they a government of on was preceding , they a preceding -- were deeds as they as a i . is -- was preceding may , general , and than two were [unk] [unk] and `` [unk] '' had has ) his one '' [unk] '' . [eos] cls2 - sp0 : -168.78 -2.56 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his him '' '' . [eos] cls2 - sp1 : -169.52 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had has gloomy his him '' '' . [eos] cls2 - sp2 : -169.61 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his `` '' '' . [eos] cls2 - sp3 : -169.92 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his him [unk] '' . [eos] cls2 - sp4 : -169.92 -2.57 67 0.74 [bos] : a : and and is , he were made no , to some his `` state '' and they a gloomy of on was gloomy , they a gloomy -- other state as were as a i the [unk] -- was number gloomy , new , gloomy and `` streets [unk] [unk] and `` [unk] '' had : gloomy his him '' [unk] . [eos] cls3 - sp0 : -126.77 -1.98 65 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` streets [unk] [unk] and `` [unk] '' had has of his him . [eos] cls3 - sp1 : -127.43 -1.93 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` come [unk] [unk] and `` [unk] '' had has of his him '' [unk] . [eos] cls3 - sp2 : -127.53 -1.93 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` streets [unk] [unk] and `` [unk] '' had has of his him '' [unk] . [eos] cls3 - sp3 : -128.03 -1.94 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` come [unk] [unk] and `` [unk] '' had has of his `` '' [unk] . [eos] cls3 - sp4 : -128.21 -1.94 67 0.97 [bos] : a : and and is , he were made no , to our his `` state '' and they a state of on was state , they a major -- our state as her as a i the [unk] -- was church state , new , and and `` come [unk] [unk] and `` [unk] '' had has of his one and [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-256 src: none none 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt0: mod/noi/dif/loss/nce/logp -119.66/-3.56 /-116.10/0.69/-0.69 -3.63 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt1: mod/noi/dif/loss/nce/logp -119.66/-3.56 /-116.10/ /-0.69 -3.63 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt2: mod/noi/dif/loss/nce/logp -213.03/-12.30 /-200.73/ /-85.32 -106.52/-6.15 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -225.56/-12.18 /-213.38/ /-97.97 -37.59/-2.03 7 [bos] it was i who paid [eos] tgt4: mod/noi/dif/loss/nce/logp -143.20/-15.42 /-127.78/ /-12.38 -4.34 /-0.47 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at fifty [unk] and the los angeles athletic club . [eos] tgt5: mod/noi/dif/loss/nce/logp -327.74/-13.43 /-314.31/ /-198.90 -19.28/-0.79 18 [bos] it was i who paid for our little home , the food , the liquor . [eos] cls0 - sp0 : -66.68 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the streets , the cleaning -- they [unk] deck at his [unk] and the joined preceding be united . [eos] cls0 - sp1 : -66.69 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the cleaning , the cleaning -- they [unk] deck at his [unk] and the joined preceding be united . [eos] cls0 - sp2 : -66.69 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the streets , the cleaning -- they [unk] organized at his [unk] and the joined preceding be united . [eos] cls0 - sp3 : -66.70 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the cleaning , the cleaning -- they [unk] organized at his [unk] and the joined preceding be united . [eos] cls0 - sp4 : -66.79 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the streets , the cleaning -- they [unk] deck at his [unk] and the joined preceding be society . [eos] cls1 - sp0 : -95.69 -2.90 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] deck at his [unk] and the joined discussed first activity . [eos] cls1 - sp1 : -95.78 -2.90 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] landed at his [unk] and the joined discussed first activity . [eos] cls1 - sp2 : -95.85 -2.90 34 0.27 [bos] '' was i who who is would most ! , the deck , the cleaning , the indifferent -- they [unk] deck at his [unk] and the joined discussed first activity . [eos] cls1 - sp3 : -95.87 -2.91 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] cleaning at his [unk] and the joined discussed first activity . [eos] cls1 - sp4 : -95.96 -2.91 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] organized at his [unk] and the joined discussed first activity . [eos] cls2 - sp0 : -90.19 -2.73 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] telephone at his [unk] and the laughed made made state . [eos] cls2 - sp1 : -90.24 -2.73 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] telephone at his [unk] and the laughed reliable made state . [eos] cls2 - sp2 : -90.25 -2.73 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] indifferent at his [unk] and the laughed made made state . [eos] cls2 - sp3 : -90.30 -2.74 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] indifferent at his [unk] and the laughed reliable made state . [eos] cls2 - sp4 : -90.31 -2.74 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the laughed made made state . [eos] cls3 - sp0 : -68.52 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the streets , the telephone -- they [unk] streets at his [unk] and the first made made state . [eos] cls3 - sp1 : -68.54 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the streets , the telephone -- they [unk] crime at his [unk] and the first made made state . [eos] cls3 - sp2 : -68.59 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the state , the telephone -- they [unk] crime at his [unk] and the first made made state . [eos] cls3 - sp3 : -68.60 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the crime , the telephone -- they [unk] streets at his [unk] and the first made made state . [eos] cls3 - sp4 : -68.61 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the crime , the telephone -- they [unk] crime at his [unk] and the first made made state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-257 src: none none 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt0: mod/noi/dif/loss/nce/logp -122.88/-3.56 /-119.33/0.69/-0.69 -3.72 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt1: mod/noi/dif/loss/nce/logp -122.88/-3.56 /-119.33/ /-0.69 -3.72 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt2: mod/noi/dif/loss/nce/logp -212.91/-12.30 /-200.61/ /-81.98 -106.46/-6.15 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -225.28/-12.18 /-213.10/ /-94.47 -37.55/-2.03 7 [bos] it was i who paid [eos] tgt4: mod/noi/dif/loss/nce/logp -147.57/-15.42 /-132.15/ /-13.51 -4.47 /-0.47 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at fifty [unk] and the los angeles athletic club . [eos] tgt5: mod/noi/dif/loss/nce/logp -329.35/-13.43 /-315.92/ /-197.28 -19.37/-0.79 18 [bos] it was i who paid for our little home , the food , the liquor . [eos] cls0 - sp0 : -66.68 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the streets , the cleaning -- they [unk] deck at his [unk] and the joined preceding be united . [eos] cls0 - sp1 : -66.69 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the cleaning , the cleaning -- they [unk] deck at his [unk] and the joined preceding be united . [eos] cls0 - sp2 : -66.69 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the streets , the cleaning -- they [unk] organized at his [unk] and the joined preceding be united . [eos] cls0 - sp3 : -66.70 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the cleaning , the cleaning -- they [unk] organized at his [unk] and the joined preceding be united . [eos] cls0 - sp4 : -66.79 -2.02 34 0.00 [bos] it is i who general is would most its , the deck , the streets , the cleaning -- they [unk] deck at his [unk] and the joined preceding be society . [eos] cls1 - sp0 : -95.69 -2.90 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] deck at his [unk] and the joined discussed first activity . [eos] cls1 - sp1 : -95.78 -2.90 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] landed at his [unk] and the joined discussed first activity . [eos] cls1 - sp2 : -95.85 -2.90 34 0.27 [bos] '' was i who who is would most ! , the deck , the cleaning , the indifferent -- they [unk] deck at his [unk] and the joined discussed first activity . [eos] cls1 - sp3 : -95.87 -2.91 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] cleaning at his [unk] and the joined discussed first activity . [eos] cls1 - sp4 : -95.96 -2.91 34 0.27 [bos] '' was i who who is they most ! , the deck , the cleaning , the indifferent -- they [unk] organized at his [unk] and the joined discussed first activity . [eos] cls2 - sp0 : -90.19 -2.73 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] telephone at his [unk] and the laughed made made state . [eos] cls2 - sp1 : -90.24 -2.73 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] telephone at his [unk] and the laughed reliable made state . [eos] cls2 - sp2 : -90.25 -2.73 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] indifferent at his [unk] and the laughed made made state . [eos] cls2 - sp3 : -90.30 -2.74 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] indifferent at his [unk] and the laughed reliable made state . [eos] cls2 - sp4 : -90.31 -2.74 34 0.73 [bos] : is i who who is on life ! , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the laughed made made state . [eos] cls3 - sp0 : -68.52 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the streets , the telephone -- they [unk] streets at his [unk] and the first made made state . [eos] cls3 - sp1 : -68.54 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the streets , the telephone -- they [unk] crime at his [unk] and the first made made state . [eos] cls3 - sp2 : -68.59 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the state , the telephone -- they [unk] crime at his [unk] and the first made made state . [eos] cls3 - sp3 : -68.60 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the crime , the telephone -- they [unk] streets at his [unk] and the first made made state . [eos] cls3 - sp4 : -68.61 -2.08 34 1.00 [bos] it is i who state is on personal much , the state , the crime , the telephone -- they [unk] crime at his [unk] and the first made made state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-258 src: none none 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt0: mod/noi/dif/loss/nce/logp -117.32/-3.56 /-113.76/0.69/-0.69 -3.56 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt1: mod/noi/dif/loss/nce/logp -117.32/-3.56 /-113.76/ /-0.69 -3.56 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt2: mod/noi/dif/loss/nce/logp -209.74/-12.30 /-197.44/ /-84.37 -104.87/-6.15 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -223.80/-12.18 /-211.62/ /-98.55 -37.30/-2.03 7 [bos] it was i who paid [eos] tgt4: mod/noi/dif/loss/nce/logp -141.05/-15.42 /-125.63/ /-12.56 -4.27 /-0.47 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at fifty [unk] and the los angeles athletic club . [eos] tgt5: mod/noi/dif/loss/nce/logp -327.75/-13.43 /-314.31/ /-201.24 -19.28/-0.79 18 [bos] it was i who paid for our little home , the food , the liquor . [eos] cls0 - sp0 : -63.99 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome joined society states . [eos] cls0 - sp1 : -64.02 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome preceding society you . [eos] cls0 - sp2 : -64.03 -1.94 34 0.00 [bos] it was i who are is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome preceding society you . [eos] cls0 - sp3 : -64.05 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome joined society you . [eos] cls0 - sp4 : -64.05 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] governor's at his [unk] and the rome joined society states . [eos] cls1 - sp0 : -80.69 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the she , the cleaning -- they [unk] skies at his [unk] and the rome discussed cleaning -- . [eos] cls1 - sp1 : -80.85 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the she , the cleaning -- they [unk] skies at his [unk] and the rome discussed wherever -- . [eos] cls1 - sp2 : -80.87 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the couldn't , the cleaning -- they [unk] delivering at his [unk] and the rome discussed cleaning -- . [eos] cls1 - sp3 : -80.88 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the she , the cleaning -- they [unk] delivering at his [unk] and the rome discussed cleaning -- . [eos] cls1 - sp4 : -80.91 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the couldn't , the cleaning -- they [unk] delivering at his [unk] and the rome discussed wherever -- . [eos] cls2 - sp0 : -84.30 -2.55 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the few discussed crime -- . [eos] cls2 - sp1 : -84.37 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the later discussed crime -- . [eos] cls2 - sp2 : -84.46 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the few discussed agree -- . [eos] cls2 - sp3 : -84.46 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] indifferent at his [unk] and the few discussed crime -- . [eos] cls2 - sp4 : -84.55 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the few discussed reliable -- . [eos] cls3 - sp0 : -66.13 -2.00 34 1.00 [bos] it is i who state is they later were , the state , the first , the telephone -- as [unk] crime at his [unk] and the personal agree example -- . [eos] cls3 - sp1 : -66.14 -2.00 34 1.00 [bos] it is i who state is they later were , the state , the first , the telephone -- as [unk] crime at his [unk] and the personal made example -- . [eos] cls3 - sp2 : -66.15 -2.00 34 1.00 [bos] it is i who state is they later were , the state , the all , the telephone -- as [unk] crime at his [unk] and the personal agree example -- . [eos] cls3 - sp3 : -66.17 -2.01 34 1.00 [bos] it is i who state is they later were , the state , the all , the telephone -- as [unk] crime at his [unk] and the personal made example -- . [eos] cls3 - sp4 : -66.21 -2.01 34 1.00 [bos] it is i who state is they later were , the state , the first , the telephone -- as [unk] crime at his [unk] and the personal made first -- . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-259 src: none none 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt0: mod/noi/dif/loss/nce/logp -121.35/-3.56 /-117.80/0.69/-0.69 -3.68 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt1: mod/noi/dif/loss/nce/logp -121.35/-3.56 /-117.80/ /-0.69 -3.68 /-0.11 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at his [unk] and the los angeles athletic club . [eos] tgt2: mod/noi/dif/loss/nce/logp -209.85/-12.30 /-197.55/ /-80.45 -104.92/-6.15 3 [bos] it [eos] tgt3: mod/noi/dif/loss/nce/logp -223.75/-12.18 /-211.57/ /-94.47 -37.29/-2.03 7 [bos] it was i who paid [eos] tgt4: mod/noi/dif/loss/nce/logp -146.14/-15.42 /-130.72/ /-13.61 -4.43 /-0.47 34 [bos] it was i who paid for our little home , the food , the liquor , the servants -- even [unk] bills at fifty [unk] and the los angeles athletic club . [eos] tgt5: mod/noi/dif/loss/nce/logp -328.24/-13.43 /-314.81/ /-197.70 -19.31/-0.79 18 [bos] it was i who paid for our little home , the food , the liquor . [eos] cls0 - sp0 : -63.99 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome joined society states . [eos] cls0 - sp1 : -64.02 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome preceding society you . [eos] cls0 - sp2 : -64.03 -1.94 34 0.00 [bos] it was i who are is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome preceding society you . [eos] cls0 - sp3 : -64.05 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] cleaning at his [unk] and the rome joined society you . [eos] cls0 - sp4 : -64.05 -1.94 34 0.00 [bos] it was i who much is has any its , the society , the first , the joined -- as [unk] governor's at his [unk] and the rome joined society states . [eos] cls1 - sp0 : -80.69 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the she , the cleaning -- they [unk] skies at his [unk] and the rome discussed cleaning -- . [eos] cls1 - sp1 : -80.85 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the she , the cleaning -- they [unk] skies at his [unk] and the rome discussed wherever -- . [eos] cls1 - sp2 : -80.87 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the couldn't , the cleaning -- they [unk] delivering at his [unk] and the rome discussed cleaning -- . [eos] cls1 - sp3 : -80.88 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the she , the cleaning -- they [unk] delivering at his [unk] and the rome discussed cleaning -- . [eos] cls1 - sp4 : -80.91 -2.45 34 0.27 [bos] it was i who much for they any its , the rome , the couldn't , the cleaning -- they [unk] delivering at his [unk] and the rome discussed wherever -- . [eos] cls2 - sp0 : -84.30 -2.55 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the few discussed crime -- . [eos] cls2 - sp1 : -84.37 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the later discussed crime -- . [eos] cls2 - sp2 : -84.46 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the few discussed agree -- . [eos] cls2 - sp3 : -84.46 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] indifferent at his [unk] and the few discussed crime -- . [eos] cls2 - sp4 : -84.55 -2.56 34 0.73 [bos] it was i who much for they later were , the state , the telephone , the telephone -- they [unk] crime at his [unk] and the few discussed reliable -- . [eos] cls3 - sp0 : -66.13 -2.00 34 1.00 [bos] it is i who state is they later were , the state , the first , the telephone -- as [unk] crime at his [unk] and the personal agree example -- . [eos] cls3 - sp1 : -66.14 -2.00 34 1.00 [bos] it is i who state is they later were , the state , the first , the telephone -- as [unk] crime at his [unk] and the personal made example -- . [eos] cls3 - sp2 : -66.15 -2.00 34 1.00 [bos] it is i who state is they later were , the state , the all , the telephone -- as [unk] crime at his [unk] and the personal agree example -- . [eos] cls3 - sp3 : -66.17 -2.01 34 1.00 [bos] it is i who state is they later were , the state , the all , the telephone -- as [unk] crime at his [unk] and the personal made example -- . [eos] cls3 - sp4 : -66.21 -2.01 34 1.00 [bos] it is i who state is they later were , the state , the first , the telephone -- as [unk] crime at his [unk] and the personal made first -- . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-260 src: none none 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt0: mod/noi/dif/loss/nce/logp -235.47/-4.83 /-230.64/6.44/-6.44 -4.71 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt1: mod/noi/dif/loss/nce/logp -235.47/-4.83 /-230.64/ /-6.44 -4.71 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt2: mod/noi/dif/loss/nce/logp -326.85/-12.36 /-314.49/ /-90.29 -36.32/-1.37 10 [bos] our last joint venture , [unk] lady . [eos] tgt3: mod/noi/dif/loss/nce/logp -240.01/-15.82 /-224.20/ /-0.00 -4.80 /-0.32 51 [bos] our last joint assist , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt4: mod/noi/dif/loss/nce/logp -259.89/-15.87 /-244.01/ /-19.82 -5.20 /-0.32 51 [bos] our last joint venture , [unk] lady , the deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt5: mod/noi/dif/loss/nce/logp -268.83/-15.75 /-253.08/ /-28.88 -5.49 /-0.32 50 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish [eos] cls0 - sp0 : -107.02 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to preceding . [eos] cls0 - sp1 : -107.07 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding first would preceding with the [unk] of on first preceding in . is . is was a states from other to preceding . [eos] cls0 - sp2 : -107.13 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to shall . [eos] cls0 - sp3 : -107.15 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is vertex on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to preceding . [eos] cls0 - sp4 : -107.16 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to society . [eos] cls1 - sp0 : -119.60 -2.39 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding first would deeds with the [unk] of on all preceding in . is made , was a states from other to preceding . [eos] cls1 - sp1 : -119.73 -2.39 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding would would deeds with the [unk] of on first preceding in . is made , was a states from other to preceding . [eos] cls1 - sp2 : -119.76 -2.40 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding first would deeds with the [unk] of on all preceding in . is be , was a states from other to preceding . [eos] cls1 - sp3 : -119.77 -2.40 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding would would deeds with the [unk] of `` all preceding in . is made , was a states from other to preceding . [eos] cls1 - sp4 : -119.80 -2.40 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding would would deeds with the [unk] of on all preceding in . is made , was a states from other to preceding . [eos] cls2 - sp0 : -123.81 -2.48 51 0.74 [bos] : who rome boards , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on all gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp1 : -123.82 -2.48 51 0.74 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on all gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp2 : -123.86 -2.48 51 0.74 [bos] : who rome boards , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on first gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp3 : -123.87 -2.48 51 0.74 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of on all gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp4 : -123.88 -2.48 51 0.74 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on first gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls3 - sp0 : -114.87 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of `` first of in center , people , was a state from other to state . [eos] cls3 - sp1 : -114.99 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of `` first of in center , people , was a state from other to state . [eos] cls3 - sp2 : -115.01 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of `` first of in center , people , was a state from other to people . [eos] cls3 - sp3 : -115.03 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its crime be would of with the [unk] of `` first of in center , people , was a state from other to state . [eos] cls3 - sp4 : -115.04 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of `` first of in center , people , was a people from other to state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-261 src: none none 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt0: mod/noi/dif/loss/nce/logp -224.65/-4.83 /-219.82/7.13/-7.13 -4.49 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt1: mod/noi/dif/loss/nce/logp -224.65/-4.83 /-219.82/ /-7.13 -4.49 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt2: mod/noi/dif/loss/nce/logp -323.18/-12.36 /-310.82/ /-98.13 -35.91/-1.37 10 [bos] our last joint venture , [unk] lady . [eos] tgt3: mod/noi/dif/loss/nce/logp -228.50/-15.82 /-212.69/ /-0.00 -4.57 /-0.32 51 [bos] our last joint assist , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt4: mod/noi/dif/loss/nce/logp -247.95/-15.87 /-232.08/ /-19.39 -4.96 /-0.32 51 [bos] our last joint venture , [unk] lady , the deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt5: mod/noi/dif/loss/nce/logp -266.13/-15.75 /-250.38/ /-37.69 -5.43 /-0.32 50 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish [eos] cls0 - sp0 : -107.02 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to preceding . [eos] cls0 - sp1 : -107.07 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding first would preceding with the [unk] of on first preceding in . is . is was a states from other to preceding . [eos] cls0 - sp2 : -107.13 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to shall . [eos] cls0 - sp3 : -107.15 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is vertex on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to preceding . [eos] cls0 - sp4 : -107.16 -2.14 51 0.06 [bos] : who streets preceding , [unk] states , a preceding . is 250 on the out of men part , and governor's so that its preceding would would preceding with the [unk] of on first preceding in . is . is was a states from other to society . [eos] cls1 - sp0 : -119.60 -2.39 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding first would deeds with the [unk] of on all preceding in . is made , was a states from other to preceding . [eos] cls1 - sp1 : -119.73 -2.39 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding would would deeds with the [unk] of on first preceding in . is made , was a states from other to preceding . [eos] cls1 - sp2 : -119.76 -2.40 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding first would deeds with the [unk] of on all preceding in . is be , was a states from other to preceding . [eos] cls1 - sp3 : -119.77 -2.40 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding would would deeds with the [unk] of `` all preceding in . is made , was a states from other to preceding . [eos] cls1 - sp4 : -119.80 -2.40 51 0.26 [bos] : who rome boards , [unk] rather , a . is is crime on the out of men to , and delivering so that its preceding would would deeds with the [unk] of on all preceding in . is made , was a states from other to preceding . [eos] cls2 - sp0 : -123.81 -2.48 51 0.74 [bos] : who rome boards , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on all gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp1 : -123.82 -2.48 51 0.74 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on all gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp2 : -123.86 -2.48 51 0.74 [bos] : who rome boards , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on first gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp3 : -123.87 -2.48 51 0.74 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of on all gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls2 - sp4 : -123.88 -2.48 51 0.74 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of on first gloomy in center , gloomy , was a gloomy from other to gloomy . [eos] cls3 - sp0 : -114.87 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of `` first of in center , people , was a state from other to state . [eos] cls3 - sp1 : -114.99 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] way would of with the [unk] of `` first of in center , people , was a state from other to state . [eos] cls3 - sp2 : -115.01 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of `` first of in center , people , was a state from other to people . [eos] cls3 - sp3 : -115.03 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its crime be would of with the [unk] of `` first of in center , people , was a state from other to state . [eos] cls3 - sp4 : -115.04 -2.30 51 0.84 [bos] : who rome reliable , [unk] rather , a . is is crime on the life of people is , and crime so that its [unk] be would of with the [unk] of `` first of in center , people , was a people from other to state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-262 src: none none 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt0: mod/noi/dif/loss/nce/logp -232.62/-4.83 /-227.79/8.24/-8.24 -4.65 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt1: mod/noi/dif/loss/nce/logp -232.62/-4.83 /-227.79/ /-8.24 -4.65 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt2: mod/noi/dif/loss/nce/logp -330.15/-12.36 /-317.79/ /-98.24 -36.68/-1.37 10 [bos] our last joint venture , [unk] lady . [eos] tgt3: mod/noi/dif/loss/nce/logp -235.36/-15.82 /-219.55/ /-0.00 -4.71 /-0.32 51 [bos] our last joint assist , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt4: mod/noi/dif/loss/nce/logp -256.80/-15.87 /-240.93/ /-21.38 -5.14 /-0.32 51 [bos] our last joint venture , [unk] lady , the deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt5: mod/noi/dif/loss/nce/logp -264.68/-15.75 /-248.93/ /-29.38 -5.40 /-0.32 50 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish [eos] cls0 - sp0 : -112.40 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of because first . is . is preceding , was a society from be to there . [eos] cls0 - sp1 : -112.42 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of new first . is . is preceding , was a society from be to there . [eos] cls0 - sp2 : -112.53 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of general first . is . is preceding , was a society from be to there . [eos] cls0 - sp3 : -112.59 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of because first . is . is preceding , was a streets from be to there . [eos] cls0 - sp4 : -112.61 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of because first . is . is preceding , was a united from be to there . [eos] cls1 - sp0 : -123.25 -2.46 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would agree with the [unk] of who first crime in . is grandfather , was a streets from be to i . [eos] cls1 - sp1 : -123.25 -2.46 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who first crime in . is activity , was a `` from be to i . [eos] cls1 - sp2 : -123.26 -2.47 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would agree with the [unk] of who first crime in . is grandfather , was a streets from be to there . [eos] cls1 - sp3 : -123.27 -2.47 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who first crime in . is activity , was a `` from be to there . [eos] cls1 - sp4 : -123.29 -2.47 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who first crime in . is activity , was a streets from be to there . [eos] cls2 - sp0 : -125.21 -2.50 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and plantations so that its preceding people would discussed with the [unk] of who ( crime in . is center , was a `` from be to 2 . [eos] cls2 - sp1 : -125.26 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who ( crime in . is center , was a `` from be to 2 . [eos] cls2 - sp2 : -125.47 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and plantations so that its preceding people would discussed with the [unk] of who ( crime in . is private , was a `` from be to 2 . [eos] cls2 - sp3 : -125.51 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and plantations so that its preceding people would discussed with the [unk] of who ( crime in . is crime , was a `` from be to 2 . [eos] cls2 - sp4 : -125.53 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who ( crime in . is private , was a `` from be to 2 . [eos] cls3 - sp0 : -123.09 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in center , center , was a state from be to state . [eos] cls3 - sp1 : -123.10 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in our , center , was a state from be to state . [eos] cls3 - sp2 : -123.12 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in center , center , was a state from be to 2 . [eos] cls3 - sp3 : -123.12 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in our , center , was a state from be to 2 . [eos] cls3 - sp4 : -123.12 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and [unk] so that its state people would example with the [unk] of state about crime in center , center , was a state from be to state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-263 src: none none 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt0: mod/noi/dif/loss/nce/logp -226.16/-4.83 /-221.33/8.23/-8.23 -4.52 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt1: mod/noi/dif/loss/nce/logp -226.16/-4.83 /-221.33/ /-8.23 -4.52 /-0.10 51 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt2: mod/noi/dif/loss/nce/logp -327.50/-12.36 /-315.14/ /-102.05 -36.39/-1.37 10 [bos] our last joint venture , [unk] lady . [eos] tgt3: mod/noi/dif/loss/nce/logp -228.91/-15.82 /-213.09/ /-0.00 -4.58 /-0.32 51 [bos] our last joint assist , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt4: mod/noi/dif/loss/nce/logp -248.76/-15.87 /-232.88/ /-19.79 -4.98 /-0.32 51 [bos] our last joint venture , [unk] lady , the deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish . [eos] tgt5: mod/noi/dif/loss/nce/logp -265.80/-15.75 /-250.05/ /-36.96 -5.42 /-0.32 50 [bos] our last joint venture , [unk] lady , a deeply religious film based on the life of mother cabrini , and timed so that its release date would coincide with the [unk] of america's first saint in november , 1938 , was a fiasco from start to finish [eos] cls0 - sp0 : -112.40 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of because first . is . is preceding , was a society from be to there . [eos] cls0 - sp1 : -112.42 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of new first . is . is preceding , was a society from be to there . [eos] cls0 - sp2 : -112.53 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of general first . is . is preceding , was a society from be to there . [eos] cls0 - sp3 : -112.59 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of because first . is . is preceding , was a streets from be to there . [eos] cls0 - sp4 : -112.61 -2.25 51 0.04 [bos] : were streets a , [unk] preceding , a government rome that other on the out of guaranteed part , and governor's they that its preceding made would preceding with the [unk] of because first . is . is preceding , was a united from be to there . [eos] cls1 - sp0 : -123.25 -2.46 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would agree with the [unk] of who first crime in . is grandfather , was a streets from be to i . [eos] cls1 - sp1 : -123.25 -2.46 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who first crime in . is activity , was a `` from be to i . [eos] cls1 - sp2 : -123.26 -2.47 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would agree with the [unk] of who first crime in . is grandfather , was a streets from be to there . [eos] cls1 - sp3 : -123.27 -2.47 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who first crime in . is activity , was a `` from be to there . [eos] cls1 - sp4 : -123.29 -2.47 51 0.36 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who first crime in . is activity , was a streets from be to there . [eos] cls2 - sp0 : -125.21 -2.50 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and plantations so that its preceding people would discussed with the [unk] of who ( crime in . is center , was a `` from be to 2 . [eos] cls2 - sp1 : -125.26 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who ( crime in . is center , was a `` from be to 2 . [eos] cls2 - sp2 : -125.47 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and plantations so that its preceding people would discussed with the [unk] of who ( crime in . is private , was a `` from be to 2 . [eos] cls2 - sp3 : -125.51 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and plantations so that its preceding people would discussed with the [unk] of who ( crime in . is crime , was a `` from be to 2 . [eos] cls2 - sp4 : -125.53 -2.51 51 0.56 [bos] '' has streets than , [unk] preceding , a within like on were on the out of the did , and unison so that its preceding people would discussed with the [unk] of who ( crime in . is private , was a `` from be to 2 . [eos] cls3 - sp0 : -123.09 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in center , center , was a state from be to state . [eos] cls3 - sp1 : -123.10 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in our , center , was a state from be to state . [eos] cls3 - sp2 : -123.12 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in center , center , was a state from be to 2 . [eos] cls3 - sp3 : -123.12 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and crime so that its state people would example with the [unk] of state about crime in our , center , was a state from be to 2 . [eos] cls3 - sp4 : -123.12 -2.46 51 1.00 [bos] : were example church , [unk] streets , a year example on new on the life of the state , and [unk] so that its state people would example with the [unk] of state about crime in center , center , was a state from be to state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-264 src: none none 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -155.53/-3.15 /-152.38/14.41/-14.41 -5.02 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -155.53/-3.15 /-152.38/ /-14.41 -5.02 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -164.44/-16.35 /-148.09/ /-10.12 -5.30 /-0.53 32 [bos] did he trouble to names the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt3: mod/noi/dif/loss/nce/logp -351.74/-12.63 /-339.11/ /-201.14 -21.98/-0.79 17 [bos] did he trouble to memorize the very small part which i had `` tailor-made . [eos] tgt4: mod/noi/dif/loss/nce/logp -217.56/-13.26 /-204.30/ /-66.34 -7.25 /-0.44 31 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? [eos] tgt5: mod/noi/dif/loss/nce/logp -152.84/-14.87 /-137.97/ /-0.00 -4.93 /-0.48 32 [bos] did he trouble to mary the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] cls0 - sp0 : -69.68 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck first -- to between delivering joined an an [eos] cls0 - sp1 : -69.76 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck any -- to between delivering joined an an [eos] cls0 - sp2 : -69.80 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck there -- to between delivering joined an an [eos] cls0 - sp3 : -69.90 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck first -- to between landed joined an an [eos] cls0 - sp4 : -69.90 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck first -- to between deck joined an an [eos] cls1 - sp0 : -76.67 -2.47 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one telephone joined an an [eos] cls1 - sp1 : -77.16 -2.49 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one discussed joined an an [eos] cls1 - sp2 : -77.16 -2.49 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one telephone joined an ? [eos] cls1 - sp3 : -77.23 -2.49 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to between telephone joined an an [eos] cls1 - sp4 : -77.46 -2.50 32 0.29 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one telephone joined an ? [eos] cls2 - sp0 : -84.92 -2.74 32 0.74 [bos] : it been to flung the when life did which i -- `` first '' to his telephone , a ! crime first -- to between telephone laughed an ? [eos] cls2 - sp1 : -84.93 -2.74 32 0.74 [bos] : it been to flung the when life some which i -- `` first '' to his telephone , a ! crime first -- to between telephone laughed an ? [eos] cls2 - sp2 : -84.94 -2.74 32 0.74 [bos] : it been to flung the when life some which i -- `` first '' to his telephone , a ! crime first you to between telephone laughed an ? [eos] cls2 - sp3 : -84.95 -2.74 32 0.74 [bos] : it been to flung the when life did which i -- `` first '' to his telephone , a ! crime first you to between telephone laughed an ? [eos] cls2 - sp4 : -84.99 -2.74 32 0.74 [bos] : it been to flung the when life did which i -- `` first '' to his telephone , a ! crime there -- to between telephone laughed an ? [eos] cls3 - sp0 : -69.47 -2.24 32 1.00 [bos] : if this to crime the all life activity which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp1 : -69.54 -2.24 32 1.00 [bos] : if this to crime the all life did which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp2 : -69.57 -2.24 32 1.00 [bos] : if this to crime the all life personal which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp3 : -69.57 -2.24 32 1.00 [bos] : if this to crime the all life streets which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp4 : -69.61 -2.25 32 1.00 [bos] : if this to crime the all life activity which i -- `` first '' to his telephone , a state state first -- to life telephone 2 an an [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-265 src: none none 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -148.73/-3.15 /-145.58/12.44/-12.44 -4.80 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -148.73/-3.15 /-145.58/ /-12.44 -4.80 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -161.06/-16.35 /-144.71/ /-11.57 -5.20 /-0.53 32 [bos] did he trouble to names the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt3: mod/noi/dif/loss/nce/logp -345.15/-12.63 /-332.53/ /-199.38 -21.57/-0.79 17 [bos] did he trouble to memorize the very small part which i had `` tailor-made . [eos] tgt4: mod/noi/dif/loss/nce/logp -204.99/-13.26 /-191.73/ /-58.59 -6.83 /-0.44 31 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? [eos] tgt5: mod/noi/dif/loss/nce/logp -148.01/-14.87 /-133.14/ /-0.00 -4.77 /-0.48 32 [bos] did he trouble to mary the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] cls0 - sp0 : -69.68 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck first -- to between delivering joined an an [eos] cls0 - sp1 : -69.76 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck any -- to between delivering joined an an [eos] cls0 - sp2 : -69.80 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck there -- to between delivering joined an an [eos] cls0 - sp3 : -69.90 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck first -- to between landed joined an an [eos] cls0 - sp4 : -69.90 -2.25 32 0.00 [bos] : it its to expecting the all such part which i -- `` first '' to his cleaning , a united deck first -- to between deck joined an an [eos] cls1 - sp0 : -76.67 -2.47 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one telephone joined an an [eos] cls1 - sp1 : -77.16 -2.49 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one discussed joined an an [eos] cls1 - sp2 : -77.16 -2.49 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one telephone joined an ? [eos] cls1 - sp3 : -77.23 -2.49 32 0.26 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to between telephone joined an an [eos] cls1 - sp4 : -77.46 -2.50 32 0.29 [bos] : it its to telephone the all such did which i -- `` first '' to his telephone , a same deck first -- to one telephone joined an ? [eos] cls2 - sp0 : -84.92 -2.74 32 0.74 [bos] : it been to flung the when life did which i -- `` first '' to his telephone , a ! crime first -- to between telephone laughed an ? [eos] cls2 - sp1 : -84.93 -2.74 32 0.74 [bos] : it been to flung the when life some which i -- `` first '' to his telephone , a ! crime first -- to between telephone laughed an ? [eos] cls2 - sp2 : -84.94 -2.74 32 0.74 [bos] : it been to flung the when life some which i -- `` first '' to his telephone , a ! crime first you to between telephone laughed an ? [eos] cls2 - sp3 : -84.95 -2.74 32 0.74 [bos] : it been to flung the when life did which i -- `` first '' to his telephone , a ! crime first you to between telephone laughed an ? [eos] cls2 - sp4 : -84.99 -2.74 32 0.74 [bos] : it been to flung the when life did which i -- `` first '' to his telephone , a ! crime there -- to between telephone laughed an ? [eos] cls3 - sp0 : -69.47 -2.24 32 1.00 [bos] : if this to crime the all life activity which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp1 : -69.54 -2.24 32 1.00 [bos] : if this to crime the all life did which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp2 : -69.57 -2.24 32 1.00 [bos] : if this to crime the all life personal which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp3 : -69.57 -2.24 32 1.00 [bos] : if this to crime the all life streets which i -- `` first '' to his telephone , a state state first -- to life telephone way an an [eos] cls3 - sp4 : -69.61 -2.25 32 1.00 [bos] : if this to crime the all life activity which i -- `` first '' to his telephone , a state state first -- to life telephone 2 an an [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-266 src: none none 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -149.65/-3.15 /-146.50/16.96/-16.96 -4.83 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -149.65/-3.15 /-146.50/ /-16.96 -4.83 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -153.64/-16.35 /-137.29/ /-7.75 -4.96 /-0.53 32 [bos] did he trouble to names the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt3: mod/noi/dif/loss/nce/logp -349.46/-12.63 /-336.84/ /-207.29 -21.84/-0.79 17 [bos] did he trouble to memorize the very small part which i had `` tailor-made . [eos] tgt4: mod/noi/dif/loss/nce/logp -202.56/-13.26 /-189.30/ /-59.76 -6.75 /-0.44 31 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? [eos] tgt5: mod/noi/dif/loss/nce/logp -144.42/-14.87 /-129.54/ /-0.00 -4.66 /-0.48 32 [bos] did he trouble to mary the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] cls0 - sp0 : -54.47 -1.76 32 0.03 [bos] '' he has to states the when over one which i -- `` streets '' to his expecting , a joined rome there -- to one . is an ? [eos] cls0 - sp1 : -54.73 -1.77 32 0.03 [bos] '' he has to later the that over one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls0 - sp2 : -54.73 -1.77 32 0.03 [bos] '' he has to states the when over one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls0 - sp3 : -54.80 -1.77 32 0.03 [bos] '' he has to dr. the that over one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls0 - sp4 : -54.84 -1.77 32 0.03 [bos] '' he has to dr. the that or one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls1 - sp0 : -34.32 -1.91 19 0.44 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his [eos] cls1 - sp1 : -34.62 -1.92 19 0.44 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his [eos] cls1 - sp2 : -36.22 -2.01 19 0.44 [bos] '' he most to rather the when life -- which i -- `` i '' to his [eos] cls1 - sp3 : -43.41 -1.97 23 0.45 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls1 - sp4 : -43.59 -1.98 23 0.45 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls2 - sp0 : -34.61 -1.92 19 0.50 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his [eos] cls2 - sp1 : -34.95 -1.94 19 0.50 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his [eos] cls2 - sp2 : -43.70 -1.99 23 0.50 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls2 - sp3 : -43.92 -2.00 23 0.50 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls2 - sp4 : -61.05 -1.97 32 0.58 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his telephone , a don't rather ( -- to ; . is ? ? [eos] cls3 - sp0 : -64.98 -2.10 32 1.00 [bos] : he has to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center example an ? [eos] cls3 - sp1 : -65.02 -2.10 32 1.00 [bos] : he has to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one state example an ? [eos] cls3 - sp2 : -65.02 -2.10 32 1.00 [bos] : he later to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center example an ? [eos] cls3 - sp3 : -65.05 -2.10 32 1.00 [bos] : he has to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center 2 an ? [eos] cls3 - sp4 : -65.08 -2.10 32 1.00 [bos] : he later to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center 2 an ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-267 src: none none 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -144.96/-3.15 /-141.81/14.59/-14.59 -4.68 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -144.96/-3.15 /-141.81/ /-14.59 -4.68 /-0.10 32 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -152.51/-16.35 /-136.16/ /-8.94 -4.92 /-0.53 32 [bos] did he trouble to names the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] tgt3: mod/noi/dif/loss/nce/logp -342.76/-12.63 /-330.13/ /-202.91 -21.42/-0.79 17 [bos] did he trouble to memorize the very small part which i had `` tailor-made . [eos] tgt4: mod/noi/dif/loss/nce/logp -197.39/-13.26 /-184.13/ /-56.91 -6.58 /-0.44 31 [bos] did he trouble to memorize the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? [eos] tgt5: mod/noi/dif/loss/nce/logp -142.09/-14.87 /-127.22/ /-0.00 -4.58 /-0.48 32 [bos] did he trouble to mary the very small part which i had `` tailor-made '' to his specifications , a role eventually cut down to three short speeches ? ? [eos] cls0 - sp0 : -54.47 -1.76 32 0.03 [bos] '' he has to states the when over one which i -- `` streets '' to his expecting , a joined rome there -- to one . is an ? [eos] cls0 - sp1 : -54.73 -1.77 32 0.03 [bos] '' he has to later the that over one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls0 - sp2 : -54.73 -1.77 32 0.03 [bos] '' he has to states the when over one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls0 - sp3 : -54.80 -1.77 32 0.03 [bos] '' he has to dr. the that over one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls0 - sp4 : -54.84 -1.77 32 0.03 [bos] '' he has to dr. the that or one which i -- `` streets '' to his expecting , a joined rome there ; ( one . is an ? [eos] cls1 - sp0 : -34.32 -1.91 19 0.44 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his [eos] cls1 - sp1 : -34.62 -1.92 19 0.44 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his [eos] cls1 - sp2 : -36.22 -2.01 19 0.44 [bos] '' he most to rather the when life -- which i -- `` i '' to his [eos] cls1 - sp3 : -43.41 -1.97 23 0.45 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls1 - sp4 : -43.59 -1.98 23 0.45 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls2 - sp0 : -34.61 -1.92 19 0.50 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his [eos] cls2 - sp1 : -34.95 -1.94 19 0.50 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his [eos] cls2 - sp2 : -43.70 -1.99 23 0.50 [bos] '' he most to streets the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls2 - sp3 : -43.92 -2.00 23 0.50 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his telephone , a joined [eos] cls2 - sp4 : -61.05 -1.97 32 0.58 [bos] '' he most to rather the when life -- which i -- `` couldn't '' to his telephone , a don't rather ( -- to ; . is ? ? [eos] cls3 - sp0 : -64.98 -2.10 32 1.00 [bos] : he has to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center example an ? [eos] cls3 - sp1 : -65.02 -2.10 32 1.00 [bos] : he has to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one state example an ? [eos] cls3 - sp2 : -65.02 -2.10 32 1.00 [bos] : he later to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center example an ? [eos] cls3 - sp3 : -65.05 -2.10 32 1.00 [bos] : he has to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center 2 an ? [eos] cls3 - sp4 : -65.08 -2.10 32 1.00 [bos] : he later to streets the when life -- which i -- `` first '' to his telephone , a be state first -- to one center 2 an ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-268 src: none none 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt0: mod/noi/dif/loss/nce/logp -158.03/-4.14 /-153.89/0.69/-0.69 -4.05 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt1: mod/noi/dif/loss/nce/logp -158.03/-4.14 /-153.89/ /-0.69 -4.05 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt2: mod/noi/dif/loss/nce/logp -292.78/-12.20 /-280.59/ /-127.39 -58.56/-2.44 6 [bos] up to date . [eos] tgt3: mod/noi/dif/loss/nce/logp -181.99/-16.04 /-165.95/ /-12.76 -4.67 /-0.41 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started fifty workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt4: mod/noi/dif/loss/nce/logp -180.90/-16.02 /-164.88/ /-11.69 -4.64 /-0.41 40 [bos] up to date , however , fifty garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt5: mod/noi/dif/loss/nce/logp -181.21/-15.14 /-166.06/ /-12.87 -4.65 /-0.39 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond of the neighborhood he hadn't found it . [eos] cls0 - sp0 : -65.55 -1.87 36 0.00 [bos] : to first , other , his were was still more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the first he [eos] cls0 - sp1 : -65.59 -1.87 36 0.00 [bos] : to first , other , his were was still more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the streets he [eos] cls0 - sp2 : -65.68 -1.88 36 0.00 [bos] : to first , other , his were was still more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the united he [eos] cls0 - sp3 : -65.69 -1.88 36 0.00 [bos] : to first , other , his were was made more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the first he [eos] cls0 - sp4 : -65.70 -1.88 36 0.00 [bos] : to first , other , his were was made more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the streets he [eos] cls1 - sp0 : -87.67 -2.50 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his delivering and them any was a deeds preceding in the was he [eos] cls1 - sp1 : -87.75 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a deck , he streets they when his cleaning and them any was a passengers cleaning in the was he [eos] cls1 - sp2 : -87.78 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his delivering and them any was a deeds cleaning in the was he [eos] cls1 - sp3 : -87.80 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his cleaning and them any was a passengers cleaning in the was he [eos] cls1 - sp4 : -87.80 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his delivering and them any was a passengers cleaning in the was he [eos] cls2 - sp0 : -97.75 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his crime and it there was a crime crime in the first he streets center it . [eos] cls2 - sp1 : -97.78 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his unison and it there was a crime crime in the first he streets center it . [eos] cls2 - sp2 : -97.80 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his crime and it there was a crime crime in the couldn't he streets center it . [eos] cls2 - sp3 : -97.82 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his crime and it there was a reliable crime in the first he streets center it . [eos] cls2 - sp4 : -97.84 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his unison and it there was a reliable crime in the first he streets center it . [eos] cls3 - sp0 : -80.99 -2.08 40 0.97 [bos] : is first , were , his were was people more or center of a state , he state they state his streets and it there was a crime crime in the first he streets people it . [eos] cls3 - sp1 : -80.99 -2.08 40 1.00 [bos] : to be , were , his life was people more or center of a state , he state they state his streets and it there was a example crime in the first he streets people it . [eos] cls3 - sp2 : -81.00 -2.08 40 1.00 [bos] : to be , were , his life was people more or center of a state , he state they state his crime and it there was a example crime in the first he streets people it . [eos] cls3 - sp3 : -81.03 -2.08 40 0.97 [bos] : is first , were , his were was people more or center of a state , he state they state his streets and it there was a example crime in the first he streets people it . [eos] cls3 - sp4 : -81.04 -2.08 40 0.97 [bos] : is first , were , his were was people more or center of a state , he state they state his streets and it there was a crime crime in the first he streets center it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-269 src: none none 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt0: mod/noi/dif/loss/nce/logp -161.25/-4.14 /-157.11/0.69/-0.69 -4.13 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt1: mod/noi/dif/loss/nce/logp -161.25/-4.14 /-157.11/ /-0.69 -4.13 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt2: mod/noi/dif/loss/nce/logp -293.05/-12.20 /-280.86/ /-124.44 -58.61/-2.44 6 [bos] up to date . [eos] tgt3: mod/noi/dif/loss/nce/logp -185.93/-16.04 /-169.89/ /-13.48 -4.77 /-0.41 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started fifty workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt4: mod/noi/dif/loss/nce/logp -183.61/-16.02 /-167.59/ /-11.17 -4.71 /-0.41 40 [bos] up to date , however , fifty garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt5: mod/noi/dif/loss/nce/logp -184.08/-15.14 /-168.93/ /-12.52 -4.72 /-0.39 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond of the neighborhood he hadn't found it . [eos] cls0 - sp0 : -65.55 -1.87 36 0.00 [bos] : to first , other , his were was still more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the first he [eos] cls0 - sp1 : -65.59 -1.87 36 0.00 [bos] : to first , other , his were was still more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the streets he [eos] cls0 - sp2 : -65.68 -1.88 36 0.00 [bos] : to first , other , his were was still more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the united he [eos] cls0 - sp3 : -65.69 -1.88 36 0.00 [bos] : to first , other , his were was made more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the first he [eos] cls0 - sp4 : -65.70 -1.88 36 0.00 [bos] : to first , other , his were was made more or states of a streets , he streets they activity his expecting and it any was a preceding preceding in the streets he [eos] cls1 - sp0 : -87.67 -2.50 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his delivering and them any was a deeds preceding in the was he [eos] cls1 - sp1 : -87.75 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a deck , he streets they when his cleaning and them any was a passengers cleaning in the was he [eos] cls1 - sp2 : -87.78 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his delivering and them any was a deeds cleaning in the was he [eos] cls1 - sp3 : -87.80 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his cleaning and them any was a passengers cleaning in the was he [eos] cls1 - sp4 : -87.80 -2.51 36 0.26 [bos] : to first , were , his were was between more or states of a streets , he streets they when his delivering and them any was a passengers cleaning in the was he [eos] cls2 - sp0 : -97.75 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his crime and it there was a crime crime in the first he streets center it . [eos] cls2 - sp1 : -97.78 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his unison and it there was a crime crime in the first he streets center it . [eos] cls2 - sp2 : -97.80 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his crime and it there was a crime crime in the couldn't he streets center it . [eos] cls2 - sp3 : -97.82 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his crime and it there was a reliable crime in the first he streets center it . [eos] cls2 - sp4 : -97.84 -2.51 40 0.74 [bos] : to first , were , his were was more more or center of a telephone , he state they state his unison and it there was a reliable crime in the first he streets center it . [eos] cls3 - sp0 : -80.99 -2.08 40 0.97 [bos] : is first , were , his were was people more or center of a state , he state they state his streets and it there was a crime crime in the first he streets people it . [eos] cls3 - sp1 : -80.99 -2.08 40 1.00 [bos] : to be , were , his life was people more or center of a state , he state they state his streets and it there was a example crime in the first he streets people it . [eos] cls3 - sp2 : -81.00 -2.08 40 1.00 [bos] : to be , were , his life was people more or center of a state , he state they state his crime and it there was a example crime in the first he streets people it . [eos] cls3 - sp3 : -81.03 -2.08 40 0.97 [bos] : is first , were , his were was people more or center of a state , he state they state his streets and it there was a example crime in the first he streets people it . [eos] cls3 - sp4 : -81.04 -2.08 40 0.97 [bos] : is first , were , his were was people more or center of a state , he state they state his streets and it there was a crime crime in the first he streets center it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-270 src: none none 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt0: mod/noi/dif/loss/nce/logp -161.49/-4.14 /-157.35/0.69/-0.69 -4.14 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt1: mod/noi/dif/loss/nce/logp -161.49/-4.14 /-157.35/ /-0.69 -4.14 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt2: mod/noi/dif/loss/nce/logp -290.76/-12.20 /-278.56/ /-121.91 -58.15/-2.44 6 [bos] up to date . [eos] tgt3: mod/noi/dif/loss/nce/logp -185.91/-16.04 /-169.87/ /-13.21 -4.77 /-0.41 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started fifty workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt4: mod/noi/dif/loss/nce/logp -185.88/-16.02 /-169.86/ /-13.20 -4.77 /-0.41 40 [bos] up to date , however , fifty garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt5: mod/noi/dif/loss/nce/logp -185.08/-15.14 /-169.94/ /-13.28 -4.75 /-0.39 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond of the neighborhood he hadn't found it . [eos] cls0 - sp0 : -74.19 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets preceding in the society he preceding society it . [eos] cls0 - sp1 : -74.20 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets preceding in the society he preceding shall it . [eos] cls0 - sp2 : -74.22 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets society in the society he preceding society it . [eos] cls0 - sp3 : -74.23 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets society in the society he preceding shall it . [eos] cls0 - sp4 : -74.25 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his streets and it there was a streets preceding in the society he preceding shall it . [eos] cls1 - sp0 : -97.25 -2.49 40 0.26 [bos] : to first , -- , his united was at more or -- of a preceding , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering preceding it . [eos] cls1 - sp1 : -97.32 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a streets , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering preceding it . [eos] cls1 - sp2 : -97.45 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a preceding , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering society it . [eos] cls1 - sp3 : -97.53 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a streets , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering society it . [eos] cls1 - sp4 : -97.56 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a preceding , he governor's they when his streets and them there was a nick preceding in the plaster he delivering society it . [eos] cls2 - sp0 : -99.68 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a 2 , he housing as state his 2 and them there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp1 : -99.71 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a 2 , he housing as state his 2 and if there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp2 : -99.71 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a personal , he housing as state his 2 and them there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp3 : -99.72 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a personal , he housing as state his 2 and if there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp4 : -99.77 -2.56 40 0.74 [bos] : to first , her , his data was more more or -- of a 2 , he housing as state his 2 and them there was a reliable crime in the telephone he crime gloomy it . [eos] cls3 - sp0 : -78.55 -2.01 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a example new in the housing he crime people it . [eos] cls3 - sp1 : -78.60 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he state as state his 2 and if first was a example new in the housing he crime people it . [eos] cls3 - sp2 : -78.60 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a example crime in the housing he crime people it . [eos] cls3 - sp3 : -78.61 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a first new in the housing he crime people it . [eos] cls3 - sp4 : -78.61 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a example new in the housing he crime state it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-271 src: none none 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt0: mod/noi/dif/loss/nce/logp -161.82/-4.14 /-157.68/0.69/-0.69 -4.15 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt1: mod/noi/dif/loss/nce/logp -161.82/-4.14 /-157.68/ /-0.69 -4.15 /-0.11 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt2: mod/noi/dif/loss/nce/logp -291.57/-12.20 /-279.37/ /-122.39 -58.31/-2.44 6 [bos] up to date . [eos] tgt3: mod/noi/dif/loss/nce/logp -186.35/-16.04 /-170.31/ /-13.33 -4.78 /-0.41 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started fifty workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt4: mod/noi/dif/loss/nce/logp -185.21/-16.02 /-169.18/ /-12.20 -4.75 /-0.41 40 [bos] up to date , however , fifty garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond in the neighborhood he hadn't found it . [eos] tgt5: mod/noi/dif/loss/nce/logp -185.03/-15.14 /-169.89/ /-12.91 -4.74 /-0.39 40 [bos] up to date , however , his garden was still more or less of a mess , he hadn't even started his workshop and if there was a meadow pond of the neighborhood he hadn't found it . [eos] cls0 - sp0 : -74.19 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets preceding in the society he preceding society it . [eos] cls0 - sp1 : -74.20 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets preceding in the society he preceding shall it . [eos] cls0 - sp2 : -74.22 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets society in the society he preceding society it . [eos] cls0 - sp3 : -74.23 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his preceding and it there was a streets society in the society he preceding shall it . [eos] cls0 - sp4 : -74.25 -1.90 40 0.00 [bos] : to first , -- , his united was at more or -- of a streets , he society which or his streets and it there was a streets preceding in the society he preceding shall it . [eos] cls1 - sp0 : -97.25 -2.49 40 0.26 [bos] : to first , -- , his united was at more or -- of a preceding , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering preceding it . [eos] cls1 - sp1 : -97.32 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a streets , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering preceding it . [eos] cls1 - sp2 : -97.45 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a preceding , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering society it . [eos] cls1 - sp3 : -97.53 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a streets , he governor's they when his streets and them there was a somewhere preceding in the plaster he delivering society it . [eos] cls1 - sp4 : -97.56 -2.50 40 0.26 [bos] : to first , -- , his united was at more or -- of a preceding , he governor's they when his streets and them there was a nick preceding in the plaster he delivering society it . [eos] cls2 - sp0 : -99.68 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a 2 , he housing as state his 2 and them there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp1 : -99.71 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a 2 , he housing as state his 2 and if there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp2 : -99.71 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a personal , he housing as state his 2 and them there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp3 : -99.72 -2.56 40 0.74 [bos] : to first , her , his data was at more or -- of a personal , he housing as state his 2 and if there was a reliable crime in the telephone he crime gloomy it . [eos] cls2 - sp4 : -99.77 -2.56 40 0.74 [bos] : to first , her , his data was more more or -- of a 2 , he housing as state his 2 and them there was a reliable crime in the telephone he crime gloomy it . [eos] cls3 - sp0 : -78.55 -2.01 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a example new in the housing he crime people it . [eos] cls3 - sp1 : -78.60 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he state as state his 2 and if first was a example new in the housing he crime people it . [eos] cls3 - sp2 : -78.60 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a example crime in the housing he crime people it . [eos] cls3 - sp3 : -78.61 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a first new in the housing he crime people it . [eos] cls3 - sp4 : -78.61 -2.02 40 1.00 [bos] : to first , -- , his state was him more or -- of a personal , he people as state his 2 and if first was a example new in the housing he crime state it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-272 src: none none 10 [bos] or was the answer less metaphysical ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -29.16 /-0.98 /-28.18 /0.69/-0.69 -3.24 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -29.16 /-0.98 /-28.18 / /-0.69 -3.24 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -73.64 /-11.28 /-62.36 / /-34.87 -9.20 /-1.41 9 [bos] or was the answer less metaphysical ? [eos] tgt3: mod/noi/dif/loss/nce/logp -76.46 /-11.63 /-64.83 / /-37.34 -9.56 /-1.45 9 [bos] or was the answer less metaphysical . [eos] tgt4: mod/noi/dif/loss/nce/logp -81.84 /-11.49 /-70.36 / /-42.87 -11.69/-1.64 8 [bos] or was the answer less metaphysical [eos] tgt5: mod/noi/dif/loss/nce/logp -50.57 /-11.42 /-39.15 / /-11.66 -5.62 /-1.27 10 [bos] or was the answer less metaphysical ? . [eos] cls0 - sp0 : -7.06 -1.41 6 0.20 [bos] ! was the ! [eos] cls0 - sp1 : -7.14 -1.43 6 0.00 [bos] or was the ! [eos] cls0 - sp2 : -7.30 -1.46 6 0.00 [bos] ! was the ! [eos] cls0 - sp3 : -7.79 -1.56 6 0.20 [bos] ! she the ! [eos] cls0 - sp4 : -8.01 -1.60 6 0.20 [bos] ! was the ! [eos] cls1 - sp0 : -7.58 -1.52 6 0.40 [bos] ! was the ! [eos] cls1 - sp1 : -8.03 -1.61 6 0.40 [bos] ! she the ! [eos] cls1 - sp2 : -8.51 -1.70 6 0.40 [bos] ! : the ! [eos] cls1 - sp3 : -10.45 -2.09 6 0.40 [bos] ! was that ! [eos] cls1 - sp4 : -10.47 -2.09 6 0.40 [bos] ! was the 7 [eos] cls2 - sp0 : -10.65 -1.78 7 0.67 [bos] ! was that ! ! [eos] cls2 - sp1 : -10.70 -1.78 7 0.67 [bos] ! : that ! ! [eos] cls2 - sp2 : -11.36 -1.89 7 0.67 [bos] ! was the ! ! [eos] cls2 - sp3 : -11.79 -1.96 7 0.67 [bos] ! : the ! ! [eos] cls2 - sp4 : -11.81 -1.97 7 0.50 [bos] ! was that ! ! [eos] cls3 - sp0 : -9.02 -1.50 7 1.00 [bos] ! she the ! ! [eos] cls3 - sp1 : -11.16 -1.24 10 1.00 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp2 : -11.23 -1.87 7 1.00 [bos] ! : the ! ! [eos] cls3 - sp3 : -11.50 -1.92 7 0.83 [bos] ! she the ! ! [eos] cls3 - sp4 : -12.17 -1.35 10 1.00 [bos] ! : the ! ! ! ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-273 src: none none 10 [bos] or was the answer less metaphysical ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -32.12 /-0.98 /-31.14 /0.69/-0.69 -3.57 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -32.12 /-0.98 /-31.14 / /-0.69 -3.57 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -72.43 /-11.28 /-61.16 / /-30.71 -9.05 /-1.41 9 [bos] or was the answer less metaphysical ? [eos] tgt3: mod/noi/dif/loss/nce/logp -75.24 /-11.63 /-63.62 / /-33.17 -9.41 /-1.45 9 [bos] or was the answer less metaphysical . [eos] tgt4: mod/noi/dif/loss/nce/logp -80.83 /-11.49 /-69.34 / /-38.90 -11.55/-1.64 8 [bos] or was the answer less metaphysical [eos] tgt5: mod/noi/dif/loss/nce/logp -52.67 /-11.42 /-41.24 / /-10.80 -5.85 /-1.27 10 [bos] or was the answer less metaphysical ? . [eos] cls0 - sp0 : -7.06 -1.41 6 0.20 [bos] ! was the ! [eos] cls0 - sp1 : -7.14 -1.43 6 0.00 [bos] or was the ! [eos] cls0 - sp2 : -7.30 -1.46 6 0.00 [bos] ! was the ! [eos] cls0 - sp3 : -7.79 -1.56 6 0.20 [bos] ! she the ! [eos] cls0 - sp4 : -8.01 -1.60 6 0.20 [bos] ! was the ! [eos] cls1 - sp0 : -7.58 -1.52 6 0.40 [bos] ! was the ! [eos] cls1 - sp1 : -8.03 -1.61 6 0.40 [bos] ! she the ! [eos] cls1 - sp2 : -8.51 -1.70 6 0.40 [bos] ! : the ! [eos] cls1 - sp3 : -10.45 -2.09 6 0.40 [bos] ! was that ! [eos] cls1 - sp4 : -10.47 -2.09 6 0.40 [bos] ! was the 7 [eos] cls2 - sp0 : -10.65 -1.78 7 0.67 [bos] ! was that ! ! [eos] cls2 - sp1 : -10.70 -1.78 7 0.67 [bos] ! : that ! ! [eos] cls2 - sp2 : -11.36 -1.89 7 0.67 [bos] ! was the ! ! [eos] cls2 - sp3 : -11.79 -1.96 7 0.67 [bos] ! : the ! ! [eos] cls2 - sp4 : -11.81 -1.97 7 0.50 [bos] ! was that ! ! [eos] cls3 - sp0 : -9.02 -1.50 7 1.00 [bos] ! she the ! ! [eos] cls3 - sp1 : -11.16 -1.24 10 1.00 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp2 : -11.23 -1.87 7 1.00 [bos] ! : the ! ! [eos] cls3 - sp3 : -11.50 -1.92 7 0.83 [bos] ! she the ! ! [eos] cls3 - sp4 : -12.17 -1.35 10 1.00 [bos] ! : the ! ! ! ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-274 src: none none 10 [bos] or was the answer less metaphysical ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -30.78 /-0.98 /-29.80 /0.69/-0.69 -3.42 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -30.78 /-0.98 /-29.80 / /-0.69 -3.42 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -73.92 /-11.28 /-62.64 / /-33.54 -9.24 /-1.41 9 [bos] or was the answer less metaphysical ? [eos] tgt3: mod/noi/dif/loss/nce/logp -106.35/-11.63 /-94.73 / /-65.62 -13.29/-1.45 9 [bos] or was the answer less metaphysical . [eos] tgt4: mod/noi/dif/loss/nce/logp -89.24 /-11.49 /-77.76 / /-48.65 -12.75/-1.64 8 [bos] or was the answer less metaphysical [eos] tgt5: mod/noi/dif/loss/nce/logp -47.96 /-11.42 /-36.54 / /-7.43 -5.33 /-1.27 10 [bos] or was the answer less metaphysical ? . [eos] cls0 - sp0 : -7.60 -1.52 6 0.20 [bos] ! she the ! [eos] cls0 - sp1 : -8.58 -1.72 6 0.00 [bos] ! was the ! [eos] cls0 - sp2 : -8.59 -1.72 6 0.20 [bos] ! was the ! [eos] cls0 - sp3 : -9.01 -1.80 6 0.20 [bos] ! she that ! [eos] cls0 - sp4 : -9.98 -2.00 6 0.20 [bos] ! : the ! [eos] cls1 - sp0 : -8.65 -1.73 6 0.40 [bos] ! she the ! [eos] cls1 - sp1 : -10.27 -2.05 6 0.40 [bos] ! was the ! [eos] cls1 - sp2 : -14.24 -1.58 10 0.44 [bos] ! was that ! ! ! ? ? [eos] cls1 - sp3 : -14.35 -1.59 10 0.44 [bos] ! was that ! ! ! ? ? [eos] cls1 - sp4 : -14.61 -1.62 10 0.44 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp0 : -13.67 -1.52 10 0.56 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp1 : -14.18 -1.58 10 0.56 [bos] ! was the ! ! ! ? ? [eos] cls2 - sp2 : -14.37 -1.60 10 0.56 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp3 : -14.45 -1.61 10 0.56 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp4 : -14.73 -1.64 10 0.56 [bos] ! was the ! ! ! ? ? [eos] cls3 - sp0 : -9.48 -1.05 10 1.00 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp1 : -11.47 -1.27 10 0.89 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp2 : -11.55 -1.28 10 0.89 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp3 : -11.56 -1.28 10 1.00 [bos] ! we the ! ! ! ? ? [eos] cls3 - sp4 : -11.89 -1.32 10 0.89 [bos] ! she the ! ! ! ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-275 src: none none 10 [bos] or was the answer less metaphysical ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -33.30 /-0.98 /-32.32 /0.69/-0.69 -3.70 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -33.30 /-0.98 /-32.32 / /-0.69 -3.70 /-0.11 10 [bos] or was the answer less metaphysical ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -73.58 /-11.28 /-62.30 / /-30.67 -9.20 /-1.41 9 [bos] or was the answer less metaphysical ? [eos] tgt3: mod/noi/dif/loss/nce/logp -92.49 /-11.63 /-80.86 / /-49.23 -11.56/-1.45 9 [bos] or was the answer less metaphysical . [eos] tgt4: mod/noi/dif/loss/nce/logp -88.15 /-11.49 /-76.66 / /-45.03 -12.59/-1.64 8 [bos] or was the answer less metaphysical [eos] tgt5: mod/noi/dif/loss/nce/logp -51.07 /-11.42 /-39.65 / /-8.02 -5.67 /-1.27 10 [bos] or was the answer less metaphysical ? . [eos] cls0 - sp0 : -7.60 -1.52 6 0.20 [bos] ! she the ! [eos] cls0 - sp1 : -8.58 -1.72 6 0.00 [bos] ! was the ! [eos] cls0 - sp2 : -8.59 -1.72 6 0.20 [bos] ! was the ! [eos] cls0 - sp3 : -9.01 -1.80 6 0.20 [bos] ! she that ! [eos] cls0 - sp4 : -9.98 -2.00 6 0.20 [bos] ! : the ! [eos] cls1 - sp0 : -8.65 -1.73 6 0.40 [bos] ! she the ! [eos] cls1 - sp1 : -10.27 -2.05 6 0.40 [bos] ! was the ! [eos] cls1 - sp2 : -14.24 -1.58 10 0.44 [bos] ! was that ! ! ! ? ? [eos] cls1 - sp3 : -14.35 -1.59 10 0.44 [bos] ! was that ! ! ! ? ? [eos] cls1 - sp4 : -14.61 -1.62 10 0.44 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp0 : -13.67 -1.52 10 0.56 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp1 : -14.18 -1.58 10 0.56 [bos] ! was the ! ! ! ? ? [eos] cls2 - sp2 : -14.37 -1.60 10 0.56 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp3 : -14.45 -1.61 10 0.56 [bos] ! was that ! ! ! ? ? [eos] cls2 - sp4 : -14.73 -1.64 10 0.56 [bos] ! was the ! ! ! ? ? [eos] cls3 - sp0 : -9.48 -1.05 10 1.00 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp1 : -11.47 -1.27 10 0.89 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp2 : -11.55 -1.28 10 0.89 [bos] ! she the ! ! ! ? ? [eos] cls3 - sp3 : -11.56 -1.28 10 1.00 [bos] ! we the ! ! ! ? ? [eos] cls3 - sp4 : -11.89 -1.32 10 0.89 [bos] ! she the ! ! ! ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-276 src: none none 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt0: mod/noi/dif/loss/nce/logp -124.47/-1.95 /-122.53/8.54/-8.54 -6.22 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt1: mod/noi/dif/loss/nce/logp -124.47/-1.95 /-122.53/ /-8.54 -6.22 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt2: mod/noi/dif/loss/nce/logp -150.54/-13.85 /-136.69/ /-22.70 -7.53 /-0.69 21 [bos] he turned over impatiently and pulled the sheet over fifty head against the treacherous encroachment of the dawn . [eos] tgt3: mod/noi/dif/loss/nce/logp -163.92/-12.90 /-151.02/ /-37.04 -8.63 /-0.68 20 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn [eos] tgt4: mod/noi/dif/loss/nce/logp -162.04/-13.03 /-149.01/ /-35.02 -7.72 /-0.62 22 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . . [eos] tgt5: mod/noi/dif/loss/nce/logp -126.53/-12.55 /-113.99/ /-0.00 -6.33 /-0.63 21 [bos] he turned over impatiently and pulled the sheet over his head against the realistically encroachment of the dawn . [eos] cls0 - sp0 : -45.73 -2.29 21 0.10 [bos] i most not cleaning and cleaning the joined over his all . is telephone cleaning of the deck . [eos] cls0 - sp1 : -45.79 -2.29 21 0.05 [bos] i this not watching and streets the joined over his couldn't . is pain cleaning of the deck . [eos] cls0 - sp2 : -45.82 -2.29 21 0.10 [bos] i most not cleaning and editor the joined over his couldn't . is telephone cleaning of the deck . [eos] cls0 - sp3 : -45.85 -2.29 21 0.05 [bos] i any not watching and streets the joined over his couldn't . is pain cleaning of the deck . [eos] cls0 - sp4 : -45.88 -2.29 21 0.10 [bos] i most not watching and streets the joined over his couldn't . is telephone cleaning of the deck . [eos] cls1 - sp0 : -9.86 -2.47 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -49.00 -2.45 21 0.25 [bos] i most not 7 and telephone the joined about his all . is telephone cleaning of the deck . [eos] cls1 - sp2 : -49.14 -2.46 21 0.30 [bos] i most not 7 and telephone the joined over his all . is telephone cleaning of the deck . [eos] cls1 - sp3 : -49.19 -2.46 21 0.25 [bos] i most not 7 and telephone the joined about his all . is telephone cleaning of the cleaning . [eos] cls1 - sp4 : -49.20 -2.46 21 0.25 [bos] i most not 7 and telephone the joined about his all . is telephone editor of the deck . [eos] cls2 - sp0 : -10.05 -2.51 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -10.65 -2.66 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -11.36 -2.84 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -51.87 -2.59 21 0.55 [bos] it most not flung and telephone the joined over his couldn't . is telephone telephone of the telephone . [eos] cls2 - sp4 : -52.18 -2.61 21 0.55 [bos] i most not 7 and telephone the joined over his all . is telephone telephone of the telephone . [eos] cls3 - sp0 : -9.62 -2.41 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -11.23 -2.81 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -47.98 -2.40 21 1.00 [bos] ! ! not flung and telephone the telephone over his all into the telephone telephone of the thought . [eos] cls3 - sp3 : -48.02 -2.40 21 1.00 [bos] ! ! not flung and telephone the telephone over his all into the telephone telephone of the telephone . [eos] cls3 - sp4 : -48.09 -2.40 21 1.00 [bos] ! ! not flung and telephone the telephone over his all . is telephone telephone of the thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-277 src: none none 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt0: mod/noi/dif/loss/nce/logp -114.31/-1.95 /-112.37/7.96/-7.96 -5.72 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt1: mod/noi/dif/loss/nce/logp -114.31/-1.95 /-112.37/ /-7.96 -5.72 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt2: mod/noi/dif/loss/nce/logp -141.90/-13.85 /-128.05/ /-23.65 -7.10 /-0.69 21 [bos] he turned over impatiently and pulled the sheet over fifty head against the treacherous encroachment of the dawn . [eos] tgt3: mod/noi/dif/loss/nce/logp -160.58/-12.90 /-147.69/ /-43.29 -8.45 /-0.68 20 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn [eos] tgt4: mod/noi/dif/loss/nce/logp -150.16/-13.03 /-137.13/ /-32.73 -7.15 /-0.62 22 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . . [eos] tgt5: mod/noi/dif/loss/nce/logp -116.95/-12.55 /-104.40/ /-0.00 -5.85 /-0.63 21 [bos] he turned over impatiently and pulled the sheet over his head against the realistically encroachment of the dawn . [eos] cls0 - sp0 : -45.73 -2.29 21 0.10 [bos] i most not cleaning and cleaning the joined over his all . is telephone cleaning of the deck . [eos] cls0 - sp1 : -45.79 -2.29 21 0.05 [bos] i this not watching and streets the joined over his couldn't . is pain cleaning of the deck . [eos] cls0 - sp2 : -45.82 -2.29 21 0.10 [bos] i most not cleaning and editor the joined over his couldn't . is telephone cleaning of the deck . [eos] cls0 - sp3 : -45.85 -2.29 21 0.05 [bos] i any not watching and streets the joined over his couldn't . is pain cleaning of the deck . [eos] cls0 - sp4 : -45.88 -2.29 21 0.10 [bos] i most not watching and streets the joined over his couldn't . is telephone cleaning of the deck . [eos] cls1 - sp0 : -9.86 -2.47 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -49.00 -2.45 21 0.25 [bos] i most not 7 and telephone the joined about his all . is telephone cleaning of the deck . [eos] cls1 - sp2 : -49.14 -2.46 21 0.30 [bos] i most not 7 and telephone the joined over his all . is telephone cleaning of the deck . [eos] cls1 - sp3 : -49.19 -2.46 21 0.25 [bos] i most not 7 and telephone the joined about his all . is telephone cleaning of the cleaning . [eos] cls1 - sp4 : -49.20 -2.46 21 0.25 [bos] i most not 7 and telephone the joined about his all . is telephone editor of the deck . [eos] cls2 - sp0 : -10.05 -2.51 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -10.65 -2.66 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -11.36 -2.84 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -51.87 -2.59 21 0.55 [bos] it most not flung and telephone the joined over his couldn't . is telephone telephone of the telephone . [eos] cls2 - sp4 : -52.18 -2.61 21 0.55 [bos] i most not 7 and telephone the joined over his all . is telephone telephone of the telephone . [eos] cls3 - sp0 : -9.62 -2.41 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -11.23 -2.81 5 0.75 [bos] ! ! ! [eos] cls3 - sp2 : -47.98 -2.40 21 1.00 [bos] ! ! not flung and telephone the telephone over his all into the telephone telephone of the thought . [eos] cls3 - sp3 : -48.02 -2.40 21 1.00 [bos] ! ! not flung and telephone the telephone over his all into the telephone telephone of the telephone . [eos] cls3 - sp4 : -48.09 -2.40 21 1.00 [bos] ! ! not flung and telephone the telephone over his all . is telephone telephone of the thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-278 src: none none 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt0: mod/noi/dif/loss/nce/logp -130.95/-1.95 /-129.00/8.68/-8.68 -6.55 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt1: mod/noi/dif/loss/nce/logp -130.95/-1.95 /-129.00/ /-8.68 -6.55 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt2: mod/noi/dif/loss/nce/logp -155.00/-13.85 /-141.15/ /-20.83 -7.75 /-0.69 21 [bos] he turned over impatiently and pulled the sheet over fifty head against the treacherous encroachment of the dawn . [eos] tgt3: mod/noi/dif/loss/nce/logp -166.85/-12.90 /-153.96/ /-33.64 -8.78 /-0.68 20 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn [eos] tgt4: mod/noi/dif/loss/nce/logp -166.71/-13.03 /-153.68/ /-33.36 -7.94 /-0.62 22 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . . [eos] tgt5: mod/noi/dif/loss/nce/logp -132.86/-12.55 /-120.32/ /-0.00 -6.64 /-0.63 21 [bos] he turned over impatiently and pulled the sheet over his head against the realistically encroachment of the dawn . [eos] cls0 - sp0 : -44.04 -2.20 21 0.00 [bos] i most not later and no that any made his couldn't are the she united of the cleaning . [eos] cls0 - sp1 : -44.12 -2.21 21 0.00 [bos] i most not later and no that any made his joined are the she united of the cleaning . [eos] cls0 - sp2 : -44.21 -2.21 21 0.00 [bos] i most not later and no that any made his couldn't are the she first of the cleaning . [eos] cls0 - sp3 : -44.24 -2.21 21 0.00 [bos] i most not later and no the any made his couldn't are the she united of the cleaning . [eos] cls0 - sp4 : -44.26 -2.21 21 0.00 [bos] i most not later and no that any made his joined are the she first of the cleaning . [eos] cls1 - sp0 : -12.72 -3.18 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -40.89 -2.27 19 0.44 [bos] ! ! ! ! and ! the ? ! his ! ! ? ! ! of the [eos] cls1 - sp2 : -40.93 -2.27 19 0.39 [bos] ! ! ! ! and ! the ? ! his ! ! ? ! ! of the [eos] cls1 - sp3 : -40.94 -2.27 19 0.44 [bos] ! ! ! ! and ! the ? ! his ! ! ! ! ! of the [eos] cls1 - sp4 : -41.07 -2.28 19 0.39 [bos] ! ! ! ! and ! the ? ! his ! ! ! ! ! of the [eos] cls2 - sp0 : -13.63 -3.41 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -13.69 -3.42 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -38.63 -2.15 19 0.72 [bos] ! ! ! ! and ! the ! ! his ! ! ! ! ! of the [eos] cls2 - sp3 : -38.77 -2.15 19 0.67 [bos] ! ! ! ! and ! the ! ! his ! ! ! ! ! of the [eos] cls2 - sp4 : -38.78 -2.15 19 0.72 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp0 : -38.08 -2.12 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp1 : -38.62 -2.15 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp2 : -38.72 -2.15 19 0.83 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp3 : -39.09 -2.17 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ! ! ! of the [eos] cls3 - sp4 : -39.25 -2.18 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-279 src: none none 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt0: mod/noi/dif/loss/nce/logp -122.15/-1.95 /-120.20/8.11/-8.11 -6.11 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt1: mod/noi/dif/loss/nce/logp -122.15/-1.95 /-120.20/ /-8.11 -6.11 /-0.10 21 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . [eos] tgt2: mod/noi/dif/loss/nce/logp -149.16/-13.85 /-135.30/ /-23.21 -7.46 /-0.69 21 [bos] he turned over impatiently and pulled the sheet over fifty head against the treacherous encroachment of the dawn . [eos] tgt3: mod/noi/dif/loss/nce/logp -165.41/-12.90 /-152.52/ /-40.42 -8.71 /-0.68 20 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn [eos] tgt4: mod/noi/dif/loss/nce/logp -156.32/-13.03 /-143.29/ /-31.20 -7.44 /-0.62 22 [bos] he turned over impatiently and pulled the sheet over his head against the treacherous encroachment of the dawn . . [eos] tgt5: mod/noi/dif/loss/nce/logp -124.64/-12.55 /-112.09/ /-0.00 -6.23 /-0.63 21 [bos] he turned over impatiently and pulled the sheet over his head against the realistically encroachment of the dawn . [eos] cls0 - sp0 : -44.04 -2.20 21 0.00 [bos] i most not later and no that any made his couldn't are the she united of the cleaning . [eos] cls0 - sp1 : -44.12 -2.21 21 0.00 [bos] i most not later and no that any made his joined are the she united of the cleaning . [eos] cls0 - sp2 : -44.21 -2.21 21 0.00 [bos] i most not later and no that any made his couldn't are the she first of the cleaning . [eos] cls0 - sp3 : -44.24 -2.21 21 0.00 [bos] i most not later and no the any made his couldn't are the she united of the cleaning . [eos] cls0 - sp4 : -44.26 -2.21 21 0.00 [bos] i most not later and no that any made his joined are the she first of the cleaning . [eos] cls1 - sp0 : -12.72 -3.18 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -40.89 -2.27 19 0.44 [bos] ! ! ! ! and ! the ? ! his ! ! ? ! ! of the [eos] cls1 - sp2 : -40.93 -2.27 19 0.39 [bos] ! ! ! ! and ! the ? ! his ! ! ? ! ! of the [eos] cls1 - sp3 : -40.94 -2.27 19 0.44 [bos] ! ! ! ! and ! the ? ! his ! ! ! ! ! of the [eos] cls1 - sp4 : -41.07 -2.28 19 0.39 [bos] ! ! ! ! and ! the ? ! his ! ! ! ! ! of the [eos] cls2 - sp0 : -13.63 -3.41 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -13.69 -3.42 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -38.63 -2.15 19 0.72 [bos] ! ! ! ! and ! the ! ! his ! ! ! ! ! of the [eos] cls2 - sp3 : -38.77 -2.15 19 0.67 [bos] ! ! ! ! and ! the ! ! his ! ! ! ! ! of the [eos] cls2 - sp4 : -38.78 -2.15 19 0.72 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp0 : -38.08 -2.12 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp1 : -38.62 -2.15 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp2 : -38.72 -2.15 19 0.83 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] cls3 - sp3 : -39.09 -2.17 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ! ! ! of the [eos] cls3 - sp4 : -39.25 -2.18 19 0.78 [bos] ! ! ! ! and ! the ! ! his ! ! ? ! ! of the [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-280 src: none none 12 [bos] add things as you find you need 'em '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -56.00 /-1.17 /-54.83 /1.45/-1.45 -5.09 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -56.00 /-1.17 /-54.83 / /-1.45 -5.09 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.13 /-12.12 /-74.01 / /-20.62 -8.61 /-1.21 11 [bos] add things as you find you need 'em '' [eos] tgt3: mod/noi/dif/loss/nce/logp -123.11/-22.71 /-100.41/ /-47.02 -11.19/-2.06 12 [bos] add things as you find you need 'em . . [eos] tgt4: mod/noi/dif/loss/nce/logp -92.65 /-12.33 /-80.32 / /-26.93 -7.72 /-1.03 13 [bos] add things as you find you need 'em '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -67.23 /-13.21 /-54.02 / /-0.64 -6.11 /-1.20 12 [bos] engages things as you find you need 'em '' . [eos] cls0 - sp0 : -14.79 -1.34 12 0.18 [bos] ! ! as ! ! ! ! ! '' . [eos] cls0 - sp1 : -14.91 -1.36 12 0.18 [bos] ! ! as ! ! ! ! ! '' . [eos] cls0 - sp2 : -15.35 -1.40 12 0.09 [bos] ! ! as ! ! ! ! ! '' . [eos] cls0 - sp3 : -15.57 -1.42 12 0.09 [bos] ! ! as ! or ! ! ! '' . [eos] cls0 - sp4 : -15.67 -1.42 12 0.18 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp0 : -13.44 -1.22 12 0.45 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp1 : -13.79 -1.25 12 0.36 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp2 : -13.89 -1.26 12 0.45 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp3 : -13.98 -1.27 12 0.36 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp4 : -14.15 -1.29 12 0.45 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp0 : -13.54 -1.23 12 0.55 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp1 : -13.58 -1.23 12 0.73 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp2 : -13.61 -1.24 12 0.73 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp3 : -13.72 -1.25 12 0.55 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp4 : -13.84 -1.26 12 0.55 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp0 : -12.54 -1.14 12 0.91 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp1 : -13.00 -1.18 12 0.91 [bos] ! ! ! ! ! ! ! ! '' . [eos] cls3 - sp2 : -13.14 -1.19 12 0.82 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp3 : -13.44 -1.22 12 0.82 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp4 : -13.59 -1.24 12 0.82 [bos] ! ! as ! ! ! ! ! '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-281 src: none none 12 [bos] add things as you find you need 'em '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -56.77 /-1.17 /-55.60 /0.75/-0.75 -5.16 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -56.77 /-1.17 /-55.60 / /-0.75 -5.16 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -91.24 /-12.12 /-79.12 / /-24.26 -9.12 /-1.21 11 [bos] add things as you find you need 'em '' [eos] tgt3: mod/noi/dif/loss/nce/logp -121.56/-22.71 /-98.86 / /-44.00 -11.05/-2.06 12 [bos] add things as you find you need 'em . . [eos] tgt4: mod/noi/dif/loss/nce/logp -95.55 /-12.33 /-83.22 / /-28.36 -7.96 /-1.03 13 [bos] add things as you find you need 'em '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -71.03 /-13.21 /-57.82 / /-2.96 -6.46 /-1.20 12 [bos] engages things as you find you need 'em '' . [eos] cls0 - sp0 : -14.79 -1.34 12 0.18 [bos] ! ! as ! ! ! ! ! '' . [eos] cls0 - sp1 : -14.91 -1.36 12 0.18 [bos] ! ! as ! ! ! ! ! '' . [eos] cls0 - sp2 : -15.35 -1.40 12 0.09 [bos] ! ! as ! ! ! ! ! '' . [eos] cls0 - sp3 : -15.57 -1.42 12 0.09 [bos] ! ! as ! or ! ! ! '' . [eos] cls0 - sp4 : -15.67 -1.42 12 0.18 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp0 : -13.44 -1.22 12 0.45 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp1 : -13.79 -1.25 12 0.36 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp2 : -13.89 -1.26 12 0.45 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp3 : -13.98 -1.27 12 0.36 [bos] ! ! as ! ! ! ! ! '' . [eos] cls1 - sp4 : -14.15 -1.29 12 0.45 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp0 : -13.54 -1.23 12 0.55 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp1 : -13.58 -1.23 12 0.73 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp2 : -13.61 -1.24 12 0.73 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp3 : -13.72 -1.25 12 0.55 [bos] ! ! as ! ! ! ! ! '' . [eos] cls2 - sp4 : -13.84 -1.26 12 0.55 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp0 : -12.54 -1.14 12 0.91 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp1 : -13.00 -1.18 12 0.91 [bos] ! ! ! ! ! ! ! ! '' . [eos] cls3 - sp2 : -13.14 -1.19 12 0.82 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp3 : -13.44 -1.22 12 0.82 [bos] ! ! as ! ! ! ! ! '' . [eos] cls3 - sp4 : -13.59 -1.24 12 0.82 [bos] ! ! as ! ! ! ! ! '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-282 src: none none 12 [bos] add things as you find you need 'em '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -53.59 /-1.17 /-52.43 /2.14/-2.14 -4.87 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -53.59 /-1.17 /-52.43 / /-2.14 -4.87 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -83.12 /-12.12 /-71.00 / /-20.71 -8.31 /-1.21 11 [bos] add things as you find you need 'em '' [eos] tgt3: mod/noi/dif/loss/nce/logp -118.66/-22.71 /-95.95 / /-45.66 -10.79/-2.06 12 [bos] add things as you find you need 'em . . [eos] tgt4: mod/noi/dif/loss/nce/logp -88.59 /-12.33 /-76.26 / /-25.97 -7.38 /-1.03 13 [bos] add things as you find you need 'em '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -63.77 /-13.21 /-50.56 / /-0.27 -5.80 /-1.20 12 [bos] engages things as you find you need 'em '' . [eos] cls0 - sp0 : -11.40 -1.42 9 0.12 [bos] ! ! as ! ! ! ! [eos] cls0 - sp1 : -11.49 -1.44 9 0.00 [bos] she ! as ! ! ! ! [eos] cls0 - sp2 : -11.55 -1.44 9 0.12 [bos] she ! as ! ! ! ! [eos] cls0 - sp3 : -11.57 -1.45 9 0.00 [bos] ! ! as ! ! ! ! [eos] cls0 - sp4 : -11.65 -1.46 9 0.12 [bos] ! ! as ! ! ! ! [eos] cls1 - sp0 : -10.77 -1.35 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls1 - sp1 : -11.10 -1.39 9 0.25 [bos] ! ! as ! ! ! ! [eos] cls1 - sp2 : -11.23 -1.40 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls1 - sp3 : -11.60 -1.45 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls1 - sp4 : -11.62 -1.45 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls2 - sp0 : -10.54 -1.32 9 0.50 [bos] ! ! as ! ! ! ! [eos] cls2 - sp1 : -10.54 -1.32 9 0.62 [bos] ! ! as ! ! ! ! [eos] cls2 - sp2 : -10.60 -1.33 9 0.62 [bos] ! ! as ! ! ! ! [eos] cls2 - sp3 : -10.80 -1.35 9 0.62 [bos] ! ! as ! ! ! ! [eos] cls2 - sp4 : -10.87 -1.36 9 0.50 [bos] ! ! as ! ! ! ! [eos] cls3 - sp0 : -10.02 -1.25 9 0.75 [bos] ! ! as ! ! ! ! [eos] cls3 - sp1 : -10.20 -1.27 9 0.88 [bos] ! ! as ! ! ! ! [eos] cls3 - sp2 : -10.55 -1.32 9 0.88 [bos] ! ! as ! ! ! ! [eos] cls3 - sp3 : -10.58 -1.32 9 1.00 [bos] ! ! as ! ! ! ! [eos] cls3 - sp4 : -10.73 -1.34 9 0.75 [bos] ! ! as ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-283 src: none none 12 [bos] add things as you find you need 'em '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -55.57 /-1.17 /-54.41 /0.73/-0.73 -5.05 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -55.57 /-1.17 /-54.41 / /-0.73 -5.05 /-0.11 12 [bos] add things as you find you need 'em '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -88.05 /-12.12 /-75.93 / /-22.25 -8.81 /-1.21 11 [bos] add things as you find you need 'em '' [eos] tgt3: mod/noi/dif/loss/nce/logp -119.03/-22.71 /-96.33 / /-42.64 -10.82/-2.06 12 [bos] add things as you find you need 'em . . [eos] tgt4: mod/noi/dif/loss/nce/logp -92.92 /-12.33 /-80.58 / /-26.90 -7.74 /-1.03 13 [bos] add things as you find you need 'em '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -70.35 /-13.21 /-57.13 / /-3.45 -6.40 /-1.20 12 [bos] engages things as you find you need 'em '' . [eos] cls0 - sp0 : -11.40 -1.42 9 0.12 [bos] ! ! as ! ! ! ! [eos] cls0 - sp1 : -11.49 -1.44 9 0.00 [bos] she ! as ! ! ! ! [eos] cls0 - sp2 : -11.55 -1.44 9 0.12 [bos] she ! as ! ! ! ! [eos] cls0 - sp3 : -11.57 -1.45 9 0.00 [bos] ! ! as ! ! ! ! [eos] cls0 - sp4 : -11.65 -1.46 9 0.12 [bos] ! ! as ! ! ! ! [eos] cls1 - sp0 : -10.77 -1.35 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls1 - sp1 : -11.10 -1.39 9 0.25 [bos] ! ! as ! ! ! ! [eos] cls1 - sp2 : -11.23 -1.40 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls1 - sp3 : -11.60 -1.45 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls1 - sp4 : -11.62 -1.45 9 0.38 [bos] ! ! as ! ! ! ! [eos] cls2 - sp0 : -10.54 -1.32 9 0.50 [bos] ! ! as ! ! ! ! [eos] cls2 - sp1 : -10.54 -1.32 9 0.62 [bos] ! ! as ! ! ! ! [eos] cls2 - sp2 : -10.60 -1.33 9 0.62 [bos] ! ! as ! ! ! ! [eos] cls2 - sp3 : -10.80 -1.35 9 0.62 [bos] ! ! as ! ! ! ! [eos] cls2 - sp4 : -10.87 -1.36 9 0.50 [bos] ! ! as ! ! ! ! [eos] cls3 - sp0 : -10.02 -1.25 9 0.75 [bos] ! ! as ! ! ! ! [eos] cls3 - sp1 : -10.20 -1.27 9 0.88 [bos] ! ! as ! ! ! ! [eos] cls3 - sp2 : -10.55 -1.32 9 0.88 [bos] ! ! as ! ! ! ! [eos] cls3 - sp3 : -10.58 -1.32 9 1.00 [bos] ! ! as ! ! ! ! [eos] cls3 - sp4 : -10.73 -1.34 9 0.75 [bos] ! ! as ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-284 src: none none 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt0: mod/noi/dif/loss/nce/logp -163.18/-4.04 /-159.14/0.69/-0.69 -4.18 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt1: mod/noi/dif/loss/nce/logp -163.18/-4.04 /-159.14/ /-0.69 -4.18 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt2: mod/noi/dif/loss/nce/logp -305.80/-12.91 /-292.89/ /-134.44 -23.52/-0.99 14 [bos] mr. mills had done some figuring on a scrap of paper . [eos] tgt3: mod/noi/dif/loss/nce/logp -381.81/-13.95 /-367.86/ /-209.41 -15.91/-0.58 25 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which . [eos] tgt4: mod/noi/dif/loss/nce/logp -401.76/-14.20 /-387.57/ /-229.12 -14.88/-0.53 28 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled . [eos] tgt5: mod/noi/dif/loss/nce/logp -188.22/-15.12 /-173.10/ /-14.65 -4.83 /-0.39 40 [bos] mr. mills had done some figuring on the scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] cls0 - sp0 : -76.37 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , any into a streets . [eos] cls0 - sp1 : -76.38 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , be into a streets . [eos] cls0 - sp2 : -76.42 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , any into a united . [eos] cls0 - sp3 : -76.43 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , be into a united . [eos] cls0 - sp4 : -76.43 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , property made , would , he had society -- , any into a streets . [eos] cls1 - sp0 : -98.21 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome flung of cleaning and [unk] which , property made , would , he had governor's -- , be into a somewhere . [eos] cls1 - sp1 : -98.28 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome discussed of cleaning and [unk] which , property made , would , he had governor's -- , be into a somewhere . [eos] cls1 - sp2 : -98.32 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome flung of cleaning and [unk] which , property made , would , he had governor's -- , be into a ( . [eos] cls1 - sp3 : -98.39 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome discussed of cleaning and [unk] which , property made , would , he had governor's -- , be into a ( . [eos] cls1 - sp4 : -98.41 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome discussed of governor's and [unk] which , property made , would , he had governor's -- , be into a somewhere . [eos] cls2 - sp0 : -105.45 -2.70 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes reliable of housing and [unk] which , when made , would , he had indifferent but , be into a almost . [eos] cls2 - sp1 : -105.53 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes agree of housing and [unk] which , when made , would , he had indifferent but , be into a almost . [eos] cls2 - sp2 : -105.56 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes reliable of housing and [unk] which , when made , would , he had agree but , be into a almost . [eos] cls2 - sp3 : -105.57 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes reliable of housing and [unk] which , when made , would , he had indifferent but , first into a almost . [eos] cls2 - sp4 : -105.65 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes agree of housing and [unk] which , when made , would , he had agree but , be into a almost . [eos] cls3 - sp0 : -85.10 -2.18 40 1.00 [bos] this example only were some example on a 2 of state and first but the personal example of housing and [unk] which , if made , would , he had crime but , be into a new . [eos] cls3 - sp1 : -85.10 -2.18 40 1.00 [bos] this example only were some example on a reliable of state and first but the personal example of housing and [unk] which , if made , would , he had crime but , be into a new . [eos] cls3 - sp2 : -85.11 -2.18 40 1.00 [bos] this example only were some example on a reliable of state and first but the personal example of housing and [unk] which , if made , would , he had sponsored but , be into a new . [eos] cls3 - sp3 : -85.12 -2.18 40 1.00 [bos] this example only were some example on a 2 of state and first but the personal example of housing and [unk] which , if made , would , he had sponsored but , be into a new . [eos] cls3 - sp4 : -85.13 -2.18 40 1.00 [bos] this example only were some example on a reliable of state and example but the personal example of housing and [unk] which , if made , would , he had crime but , be into a new . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-285 src: none none 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt0: mod/noi/dif/loss/nce/logp -164.14/-4.04 /-160.10/0.69/-0.69 -4.21 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt1: mod/noi/dif/loss/nce/logp -164.14/-4.04 /-160.10/ /-0.69 -4.21 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt2: mod/noi/dif/loss/nce/logp -304.78/-12.91 /-291.86/ /-132.46 -23.44/-0.99 14 [bos] mr. mills had done some figuring on a scrap of paper . [eos] tgt3: mod/noi/dif/loss/nce/logp -374.64/-13.95 /-360.69/ /-201.28 -15.61/-0.58 25 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which . [eos] tgt4: mod/noi/dif/loss/nce/logp -392.90/-14.20 /-378.70/ /-219.30 -14.55/-0.53 28 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled . [eos] tgt5: mod/noi/dif/loss/nce/logp -187.74/-15.12 /-172.62/ /-13.22 -4.81 /-0.39 40 [bos] mr. mills had done some figuring on the scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] cls0 - sp0 : -76.37 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , any into a streets . [eos] cls0 - sp1 : -76.38 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , be into a streets . [eos] cls0 - sp2 : -76.42 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , any into a united . [eos] cls0 - sp3 : -76.43 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , it made , would , he had society -- , be into a united . [eos] cls0 - sp4 : -76.43 -1.96 40 0.00 [bos] this streets had its some streets on a streets of states and preceding but the joined preceding of governor's and [unk] which , property made , would , he had society -- , any into a streets . [eos] cls1 - sp0 : -98.21 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome flung of cleaning and [unk] which , property made , would , he had governor's -- , be into a somewhere . [eos] cls1 - sp1 : -98.28 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome discussed of cleaning and [unk] which , property made , would , he had governor's -- , be into a somewhere . [eos] cls1 - sp2 : -98.32 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome flung of cleaning and [unk] which , property made , would , he had governor's -- , be into a ( . [eos] cls1 - sp3 : -98.39 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome discussed of cleaning and [unk] which , property made , would , he had governor's -- , be into a ( . [eos] cls1 - sp4 : -98.41 -2.52 40 0.26 [bos] this streets were been some cleaning on a 7 of part and passengers but the rome discussed of governor's and [unk] which , property made , would , he had governor's -- , be into a somewhere . [eos] cls2 - sp0 : -105.45 -2.70 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes reliable of housing and [unk] which , when made , would , he had indifferent but , be into a almost . [eos] cls2 - sp1 : -105.53 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes agree of housing and [unk] which , when made , would , he had indifferent but , be into a almost . [eos] cls2 - sp2 : -105.56 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes reliable of housing and [unk] which , when made , would , he had agree but , be into a almost . [eos] cls2 - sp3 : -105.57 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes reliable of housing and [unk] which , when made , would , he had indifferent but , first into a almost . [eos] cls2 - sp4 : -105.65 -2.71 40 0.74 [bos] this streets were were some crime on a telephone of streets and agree but the yes agree of housing and [unk] which , when made , would , he had agree but , be into a almost . [eos] cls3 - sp0 : -85.10 -2.18 40 1.00 [bos] this example only were some example on a 2 of state and first but the personal example of housing and [unk] which , if made , would , he had crime but , be into a new . [eos] cls3 - sp1 : -85.10 -2.18 40 1.00 [bos] this example only were some example on a reliable of state and first but the personal example of housing and [unk] which , if made , would , he had crime but , be into a new . [eos] cls3 - sp2 : -85.11 -2.18 40 1.00 [bos] this example only were some example on a reliable of state and first but the personal example of housing and [unk] which , if made , would , he had sponsored but , be into a new . [eos] cls3 - sp3 : -85.12 -2.18 40 1.00 [bos] this example only were some example on a 2 of state and first but the personal example of housing and [unk] which , if made , would , he had sponsored but , be into a new . [eos] cls3 - sp4 : -85.13 -2.18 40 1.00 [bos] this example only were some example on a reliable of state and example but the personal example of housing and [unk] which , if made , would , he had crime but , be into a new . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-286 src: none none 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt0: mod/noi/dif/loss/nce/logp -168.71/-4.04 /-164.67/0.69/-0.69 -4.33 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt1: mod/noi/dif/loss/nce/logp -168.71/-4.04 /-164.67/ /-0.69 -4.33 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt2: mod/noi/dif/loss/nce/logp -311.87/-12.91 /-298.96/ /-134.98 -23.99/-0.99 14 [bos] mr. mills had done some figuring on a scrap of paper . [eos] tgt3: mod/noi/dif/loss/nce/logp -386.09/-13.95 /-372.14/ /-208.17 -16.09/-0.58 25 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which . [eos] tgt4: mod/noi/dif/loss/nce/logp -407.39/-14.20 /-393.19/ /-229.22 -15.09/-0.53 28 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled . [eos] tgt5: mod/noi/dif/loss/nce/logp -193.75/-15.12 /-178.63/ /-14.66 -4.97 /-0.39 40 [bos] mr. mills had done some figuring on the scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] cls0 - sp0 : -71.07 -1.82 40 0.03 [bos] : dr. had its -- rome on a joined of made and any but the made preceding of preceding and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp1 : -71.11 -1.82 40 0.03 [bos] '' ) -- its -- rome on a joined of made and any but the made preceding of expecting and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp2 : -71.12 -1.82 40 0.03 [bos] '' ) -- its -- rome on a joined of made and any but the made preceding of preceding and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp3 : -71.16 -1.82 40 0.03 [bos] : dr. had its -- rome on a joined of made and any but the made preceding of expecting and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp4 : -71.18 -1.83 40 0.03 [bos] : ) -- its -- rome on a joined of made and any but the made preceding of preceding and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls1 - sp0 : -94.55 -2.42 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made arch of expecting and [unk] which , i cleveland , would , he had . is , any into a somewhere . [eos] cls1 - sp1 : -94.56 -2.42 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made peculiar of expecting and [unk] which , i cleveland , would , he had . is , any into a somewhere . [eos] cls1 - sp2 : -94.63 -2.43 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made arch of expecting and [unk] which , i cleveland , would , he had . is , any into a 7 . [eos] cls1 - sp3 : -94.63 -2.43 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made peculiar of expecting and [unk] which , i cleveland , would , he had . is , any into a 7 . [eos] cls1 - sp4 : -94.64 -2.43 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and 7 but the made peculiar of expecting and [unk] which , i cleveland , would , he had . is , any into a somewhere . [eos] cls2 - sp0 : -95.66 -2.45 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had telephone but , made into a reliable . [eos] cls2 - sp1 : -95.70 -2.45 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had telephone but , made into a agree . [eos] cls2 - sp2 : -95.84 -2.46 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of crime and [unk] which , i agree , be , he had telephone but , made into a reliable . [eos] cls2 - sp3 : -95.84 -2.46 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had telephone but , made into a housing . [eos] cls2 - sp4 : -95.84 -2.46 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had discussed but , made into a reliable . [eos] cls3 - sp0 : -80.22 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the over crime of streets and [unk] which , i agree , be , he had center but , first into a first . [eos] cls3 - sp1 : -80.24 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the new crime of streets and [unk] which , i agree , be , he had center but , first into a first . [eos] cls3 - sp2 : -80.24 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the over crime of streets and [unk] which , i agree , be , he had center but , way into a first . [eos] cls3 - sp3 : -80.24 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the over crime of streets and [unk] which , i agree , would , he had center but , first into a first . [eos] cls3 - sp4 : -80.25 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the new crime of streets and [unk] which , i agree , be , he had center but , way into a first . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-287 src: none none 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt0: mod/noi/dif/loss/nce/logp -168.55/-4.04 /-164.51/0.69/-0.69 -4.32 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt1: mod/noi/dif/loss/nce/logp -168.55/-4.04 /-164.51/ /-0.69 -4.32 /-0.10 40 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] tgt2: mod/noi/dif/loss/nce/logp -309.37/-12.91 /-296.46/ /-132.63 -23.80/-0.99 14 [bos] mr. mills had done some figuring on a scrap of paper . [eos] tgt3: mod/noi/dif/loss/nce/logp -377.81/-13.95 /-363.86/ /-200.04 -15.74/-0.58 25 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which . [eos] tgt4: mod/noi/dif/loss/nce/logp -397.37/-14.20 /-383.17/ /-219.35 -14.72/-0.53 28 [bos] mr. mills had done some figuring on a scrap of paper and given him the various kinds of boards and [unk] which , properly handled . [eos] tgt5: mod/noi/dif/loss/nce/logp -191.76/-15.12 /-176.64/ /-12.82 -4.92 /-0.39 40 [bos] mr. mills had done some figuring on the scrap of paper and given him the various kinds of boards and [unk] which , properly handled , would , he had assured him , turn into a workbench . [eos] cls0 - sp0 : -71.07 -1.82 40 0.03 [bos] : dr. had its -- rome on a joined of made and any but the made preceding of preceding and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp1 : -71.11 -1.82 40 0.03 [bos] '' ) -- its -- rome on a joined of made and any but the made preceding of expecting and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp2 : -71.12 -1.82 40 0.03 [bos] '' ) -- its -- rome on a joined of made and any but the made preceding of preceding and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp3 : -71.16 -1.82 40 0.03 [bos] : dr. had its -- rome on a joined of made and any but the made preceding of expecting and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls0 - sp4 : -71.18 -1.83 40 0.03 [bos] : ) -- its -- rome on a joined of made and any but the made preceding of preceding and [unk] which , i governor's , would , he had . is , any into a streets . [eos] cls1 - sp0 : -94.55 -2.42 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made arch of expecting and [unk] which , i cleveland , would , he had . is , any into a somewhere . [eos] cls1 - sp1 : -94.56 -2.42 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made peculiar of expecting and [unk] which , i cleveland , would , he had . is , any into a somewhere . [eos] cls1 - sp2 : -94.63 -2.43 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made arch of expecting and [unk] which , i cleveland , would , he had . is , any into a 7 . [eos] cls1 - sp3 : -94.63 -2.43 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and somewhere but the made peculiar of expecting and [unk] which , i cleveland , would , he had . is , any into a 7 . [eos] cls1 - sp4 : -94.64 -2.43 40 0.26 [bos] '' ) -- its -- rome on a 7 of made and 7 but the made peculiar of expecting and [unk] which , i cleveland , would , he had . is , any into a somewhere . [eos] cls2 - sp0 : -95.66 -2.45 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had telephone but , made into a reliable . [eos] cls2 - sp1 : -95.70 -2.45 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had telephone but , made into a agree . [eos] cls2 - sp2 : -95.84 -2.46 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of crime and [unk] which , i agree , be , he had telephone but , made into a reliable . [eos] cls2 - sp3 : -95.84 -2.46 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had telephone but , made into a housing . [eos] cls2 - sp4 : -95.84 -2.46 40 0.74 [bos] : ) only were -- streets on a corner of made and any but the over crime of streets and [unk] which , i agree , be , he had discussed but , made into a reliable . [eos] cls3 - sp0 : -80.22 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the over crime of streets and [unk] which , i agree , be , he had center but , first into a first . [eos] cls3 - sp1 : -80.24 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the new crime of streets and [unk] which , i agree , be , he had center but , first into a first . [eos] cls3 - sp2 : -80.24 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the over crime of streets and [unk] which , i agree , be , he had center but , way into a first . [eos] cls3 - sp3 : -80.24 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the over crime of streets and [unk] which , i agree , would , he had center but , first into a first . [eos] cls3 - sp4 : -80.25 -2.06 40 0.95 [bos] : dr. had were some streets on a made of made and made but the new crime of streets and [unk] which , i agree , be , he had center but , way into a first . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-288 src: none none 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt0: mod/noi/dif/loss/nce/logp -157.55/-3.05 /-154.49/0.69/-0.69 -5.25 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt1: mod/noi/dif/loss/nce/logp -157.55/-3.05 /-154.49/ /-0.69 -5.25 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt2: mod/noi/dif/loss/nce/logp -241.80/-12.40 /-229.41/ /-75.61 -60.45/-3.10 5 [bos] while mr. blatz [eos] tgt3: mod/noi/dif/loss/nce/logp -201.24/-14.12 /-187.12/ /-33.32 -6.94 /-0.49 30 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar [eos] tgt4: mod/noi/dif/loss/nce/logp -174.43/-13.54 /-160.89/ /-7.09 -5.81 /-0.45 31 [bos] the mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt5: mod/noi/dif/loss/nce/logp -177.12/-13.94 /-163.18/ /-9.38 -5.90 /-0.46 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of the idea about paneling the whole end of the cellar . [eos] cls0 - sp0 : -65.08 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first first him of this joined about streets the i united of the preceding . [eos] cls0 - sp1 : -65.12 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first united him of this joined about streets the i united of the preceding . [eos] cls0 - sp2 : -65.12 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first first him of this joined about streets the i united of the expecting . [eos] cls0 - sp3 : -65.13 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first first but of this joined about streets the i united of the preceding . [eos] cls0 - sp4 : -65.16 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first united him of this joined about streets the i united of the expecting . [eos] cls1 - sp0 : -71.46 -2.38 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about organized the i united of the expecting . [eos] cls1 - sp1 : -71.47 -2.38 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about editor the i united of the expecting . [eos] cls1 - sp2 : -71.59 -2.39 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about organized the i united of the preceding . [eos] cls1 - sp3 : -71.61 -2.39 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about editor the i united of the preceding . [eos] cls1 - sp4 : -71.64 -2.39 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this editor about editor the i united of the expecting . [eos] cls2 - sp0 : -75.80 -2.53 31 0.70 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i first all but of this telephone about telephone the later telephone of the crime . [eos] cls2 - sp1 : -75.84 -2.53 31 0.70 [bos] it i first is tips who the [unk] and telephone the laughed , i couldn't all but of this telephone about telephone the later telephone of the crime . [eos] cls2 - sp2 : -76.03 -2.53 31 0.70 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i first all but of this telephone about telephone the later telephone of the mississippi . [eos] cls2 - sp3 : -76.07 -2.54 31 0.70 [bos] it i first is tips who the [unk] and telephone the laughed , i couldn't all but of this telephone about telephone the later telephone of the mississippi . [eos] cls2 - sp4 : -76.09 -2.54 31 0.70 [bos] it i first is tips who the [unk] and telephone the laughed , i couldn't all but of this telephone about telephone the later telephone of the telephone . [eos] cls3 - sp0 : -66.81 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this 2 about state the later state of the streets . [eos] cls3 - sp1 : -66.82 -2.23 31 1.00 [bos] this this first is streets who the [unk] and first the streets , i first all him of this 2 about state the later state of the streets . [eos] cls3 - sp2 : -66.83 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this 2 about state the later state of the crime . [eos] cls3 - sp3 : -66.83 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this streets about state the later state of the crime . [eos] cls3 - sp4 : -66.83 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this streets about state the later state of the streets . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-289 src: none none 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt0: mod/noi/dif/loss/nce/logp -152.24/-3.05 /-149.19/0.69/-0.69 -5.07 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt1: mod/noi/dif/loss/nce/logp -152.24/-3.05 /-149.19/ /-0.69 -5.07 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt2: mod/noi/dif/loss/nce/logp -237.13/-12.40 /-224.73/ /-76.23 -59.28/-3.10 5 [bos] while mr. blatz [eos] tgt3: mod/noi/dif/loss/nce/logp -202.50/-14.12 /-188.38/ /-39.88 -6.98 /-0.49 30 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar [eos] tgt4: mod/noi/dif/loss/nce/logp -170.93/-13.54 /-157.38/ /-8.89 -5.70 /-0.45 31 [bos] the mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt5: mod/noi/dif/loss/nce/logp -172.61/-13.94 /-158.66/ /-10.17 -5.75 /-0.46 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of the idea about paneling the whole end of the cellar . [eos] cls0 - sp0 : -65.08 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first first him of this joined about streets the i united of the preceding . [eos] cls0 - sp1 : -65.12 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first united him of this joined about streets the i united of the preceding . [eos] cls0 - sp2 : -65.12 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first first him of this joined about streets the i united of the expecting . [eos] cls0 - sp3 : -65.13 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first first but of this joined about streets the i united of the preceding . [eos] cls0 - sp4 : -65.16 -2.17 31 0.00 [bos] it i streets is expecting up the [unk] and first the streets , i first united him of this joined about streets the i united of the expecting . [eos] cls1 - sp0 : -71.46 -2.38 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about organized the i united of the expecting . [eos] cls1 - sp1 : -71.47 -2.38 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about editor the i united of the expecting . [eos] cls1 - sp2 : -71.59 -2.39 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about organized the i united of the preceding . [eos] cls1 - sp3 : -71.61 -2.39 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this joined about editor the i united of the preceding . [eos] cls1 - sp4 : -71.64 -2.39 31 0.27 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i couldn't all him of this editor about editor the i united of the expecting . [eos] cls2 - sp0 : -75.80 -2.53 31 0.70 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i first all but of this telephone about telephone the later telephone of the crime . [eos] cls2 - sp1 : -75.84 -2.53 31 0.70 [bos] it i first is tips who the [unk] and telephone the laughed , i couldn't all but of this telephone about telephone the later telephone of the crime . [eos] cls2 - sp2 : -76.03 -2.53 31 0.70 [bos] it i first is grandfather -- the [unk] and telephone the bidding , i first all but of this telephone about telephone the later telephone of the mississippi . [eos] cls2 - sp3 : -76.07 -2.54 31 0.70 [bos] it i first is tips who the [unk] and telephone the laughed , i couldn't all but of this telephone about telephone the later telephone of the mississippi . [eos] cls2 - sp4 : -76.09 -2.54 31 0.70 [bos] it i first is tips who the [unk] and telephone the laughed , i couldn't all but of this telephone about telephone the later telephone of the telephone . [eos] cls3 - sp0 : -66.81 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this 2 about state the later state of the streets . [eos] cls3 - sp1 : -66.82 -2.23 31 1.00 [bos] this this first is streets who the [unk] and first the streets , i first all him of this 2 about state the later state of the streets . [eos] cls3 - sp2 : -66.83 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this 2 about state the later state of the crime . [eos] cls3 - sp3 : -66.83 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this streets about state the later state of the crime . [eos] cls3 - sp4 : -66.83 -2.23 31 1.00 [bos] this this first is streets -- the [unk] and first the streets , i first all him of this streets about state the later state of the streets . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-290 src: none none 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt0: mod/noi/dif/loss/nce/logp -154.05/-3.05 /-151.00/0.7/-0.70 -5.14 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt1: mod/noi/dif/loss/nce/logp -154.05/-3.05 /-151.00/ /-0.70 -5.14 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt2: mod/noi/dif/loss/nce/logp -237.89/-12.40 /-225.49/ /-75.19 -59.47/-3.10 5 [bos] while mr. blatz [eos] tgt3: mod/noi/dif/loss/nce/logp -196.15/-14.12 /-182.03/ /-31.73 -6.76 /-0.49 30 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar [eos] tgt4: mod/noi/dif/loss/nce/logp -169.43/-13.54 /-155.89/ /-5.59 -5.65 /-0.45 31 [bos] the mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt5: mod/noi/dif/loss/nce/logp -174.67/-13.94 /-160.73/ /-10.43 -5.82 /-0.46 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of the idea about paneling the whole end of the cellar . [eos] cls0 - sp0 : -58.35 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets first but of this are about cleaning the there united of the joined . [eos] cls0 - sp1 : -58.36 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets first but of this are about cleaning the there united of the streets . [eos] cls0 - sp2 : -58.36 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets all but of this are about cleaning the there united of the joined . [eos] cls0 - sp3 : -58.36 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets all but of this are about cleaning the there united of the streets . [eos] cls0 - sp4 : -58.43 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets first but of this are about cleaning the most united of the joined . [eos] cls1 - sp0 : -65.84 -2.19 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the couldn't united of the joined . [eos] cls1 - sp1 : -65.91 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the couldn't united of the streets . [eos] cls1 - sp2 : -66.03 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the has united of the joined . [eos] cls1 - sp3 : -66.04 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about bidding the couldn't united of the joined . [eos] cls1 - sp4 : -66.06 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the has united of the streets . [eos] cls2 - sp0 : -71.64 -2.39 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about delivering the later when of the 7 . [eos] cls2 - sp1 : -71.84 -2.39 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about delivering the later united of the 7 . [eos] cls2 - sp2 : -71.84 -2.39 31 0.50 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about delivering the later when of the later . [eos] cls2 - sp3 : -71.84 -2.39 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about flung the later when of the 7 . [eos] cls2 - sp4 : -71.96 -2.40 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about contradiction the later when of the 7 . [eos] cls3 - sp0 : -63.07 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i first all but of this are about telephone the later state of the 2 . [eos] cls3 - sp1 : -63.07 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i first all but of this are about telephone the later state of the rome . [eos] cls3 - sp2 : -63.08 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i telephone made but of this are about telephone the later state of the 2 . [eos] cls3 - sp3 : -63.08 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i telephone made but of this are about telephone the later state of the rome . [eos] cls3 - sp4 : -63.09 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i housing made but of this are about telephone the later state of the 2 . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-291 src: none none 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt0: mod/noi/dif/loss/nce/logp -148.87/-3.05 /-145.81/0.69/-0.69 -4.96 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt1: mod/noi/dif/loss/nce/logp -148.87/-3.05 /-145.81/ /-0.69 -4.96 /-0.10 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt2: mod/noi/dif/loss/nce/logp -230.34/-12.40 /-217.95/ /-72.83 -57.59/-3.10 5 [bos] while mr. blatz [eos] tgt3: mod/noi/dif/loss/nce/logp -196.52/-14.12 /-182.40/ /-37.28 -6.78 /-0.49 30 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar [eos] tgt4: mod/noi/dif/loss/nce/logp -166.40/-13.54 /-152.86/ /-7.74 -5.55 /-0.45 31 [bos] the mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of this idea about paneling the whole end of the cellar . [eos] tgt5: mod/noi/dif/loss/nce/logp -170.49/-13.94 /-156.55/ /-11.43 -5.68 /-0.46 31 [bos] while mr. blatz was putting up the [unk] and starting the workbench , mr. crombie told him of the idea about paneling the whole end of the cellar . [eos] cls0 - sp0 : -58.35 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets first but of this are about cleaning the there united of the joined . [eos] cls0 - sp1 : -58.36 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets first but of this are about cleaning the there united of the streets . [eos] cls0 - sp2 : -58.36 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets all but of this are about cleaning the there united of the joined . [eos] cls0 - sp3 : -58.36 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets all but of this are about cleaning the there united of the streets . [eos] cls0 - sp4 : -58.43 -1.95 31 0.00 [bos] it property couldn't was world up the [unk] and wherever the streets , i streets first but of this are about cleaning the most united of the joined . [eos] cls1 - sp0 : -65.84 -2.19 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the couldn't united of the joined . [eos] cls1 - sp1 : -65.91 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the couldn't united of the streets . [eos] cls1 - sp2 : -66.03 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the has united of the joined . [eos] cls1 - sp3 : -66.04 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about bidding the couldn't united of the joined . [eos] cls1 - sp4 : -66.06 -2.20 31 0.27 [bos] it i streets is were were the [unk] and corner the bidding , i editor all but of this are about skies the has united of the streets . [eos] cls2 - sp0 : -71.64 -2.39 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about delivering the later when of the 7 . [eos] cls2 - sp1 : -71.84 -2.39 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about delivering the later united of the 7 . [eos] cls2 - sp2 : -71.84 -2.39 31 0.50 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about delivering the later when of the later . [eos] cls2 - sp3 : -71.84 -2.39 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about flung the later when of the 7 . [eos] cls2 - sp4 : -71.96 -2.40 31 0.57 [bos] it i streets is were were the [unk] and corner the bidding , i telephone all but of this are about contradiction the later when of the 7 . [eos] cls3 - sp0 : -63.07 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i first all but of this are about telephone the later state of the 2 . [eos] cls3 - sp1 : -63.07 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i first all but of this are about telephone the later state of the rome . [eos] cls3 - sp2 : -63.08 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i telephone made but of this are about telephone the later state of the 2 . [eos] cls3 - sp3 : -63.08 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i telephone made but of this are about telephone the later state of the rome . [eos] cls3 - sp4 : -63.09 -2.10 31 1.00 [bos] we if first is come who the [unk] and first the telephone , i housing made but of this are about telephone the later state of the 2 . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-292 src: none none 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt0: mod/noi/dif/loss/nce/logp -85.01 /-2.73 /-82.28 /0.69/-0.69 -3.40 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt1: mod/noi/dif/loss/nce/logp -85.01 /-2.73 /-82.28 / /-0.69 -3.40 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt2: mod/noi/dif/loss/nce/logp -206.60/-12.42 /-194.18/ /-112.59 -103.30/-6.21 3 [bos] nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -297.69/-13.29 /-284.40/ /-202.81 -18.61/-0.83 17 [bos] nothing in english has been [unk] as much as the ambiguous use of words . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.14/-13.74 /-93.40 / /-11.81 -4.29 /-0.55 26 [bos] nothing of english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt5: mod/noi/dif/loss/nce/logp -109.83/-13.44 /-96.39 / /-14.80 -4.39 /-0.54 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it , the ambiguous use of sentences . [eos] cls0 - sp0 : -39.89 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the organized or of preceding . [eos] cls0 - sp1 : -39.93 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the cleaning or of preceding . [eos] cls0 - sp2 : -39.98 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the organized or of expecting . [eos] cls0 - sp3 : -39.98 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the cleaning or of expecting . [eos] cls0 - sp4 : -39.99 -1.60 26 0.00 [bos] we in joined has been [unk] as ! as the cleaning all of when , first it be the organized or of preceding . [eos] cls1 - sp0 : -50.15 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the cleaning all of when , first it be the cleaning ! of mid-thirties . [eos] cls1 - sp1 : -50.22 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the editor all of when , first it be the cleaning ! of mid-thirties . [eos] cls1 - sp2 : -50.35 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the streets all of when , first it be the cleaning ! of mid-thirties . [eos] cls1 - sp3 : -50.35 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the cleaning all of when , first it be the editor ! of mid-thirties . [eos] cls1 - sp4 : -50.40 -2.02 26 0.28 [bos] we in corner has been [unk] as ! as the editor all of when , first it be the editor ! of mid-thirties . [eos] cls2 - sp0 : -52.52 -2.10 26 0.72 [bos] we in personal has were [unk] as ! as the telephone all of when , made it be the bidding or of mississippi . [eos] cls2 - sp1 : -52.52 -2.10 26 0.72 [bos] we in personal has were [unk] as ! as the telephone all of when , made it be the bidding or of telephone . [eos] cls2 - sp2 : -52.55 -2.10 26 0.72 [bos] we in personal has been [unk] as ! as the telephone all of when , made it be the bidding or of mississippi . [eos] cls2 - sp3 : -52.67 -2.11 26 0.68 [bos] we in personal has were [unk] as ! as the telephone all of when , made it be the bidding or of telephone . [eos] cls2 - sp4 : -52.67 -2.11 26 0.72 [bos] we in personal has were [unk] as ! as the telephone all of when , don't it be the bidding or of mississippi . [eos] cls3 - sp0 : -40.07 -1.60 26 1.00 [bos] we in personal has been [unk] as ! as the telephone all of when , first it be the telephone or of mississippi . [eos] cls3 - sp1 : -40.13 -1.61 26 1.00 [bos] we in personal has been [unk] as much as the telephone all of when , first it be the telephone or of mississippi . [eos] cls3 - sp2 : -40.14 -1.61 26 1.00 [bos] we in personal has been [unk] as ! as the telephone all of when , made it be the telephone or of mississippi . [eos] cls3 - sp3 : -40.19 -1.61 26 1.00 [bos] we in situation has been [unk] as ! as the telephone all of when , first it be the telephone or of mississippi . [eos] cls3 - sp4 : -40.20 -1.61 26 1.00 [bos] we in personal has been [unk] as ! as the telephone all of when , first it be the telephone or of telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-293 src: none none 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt0: mod/noi/dif/loss/nce/logp -83.34 /-2.73 /-80.62 /0.69/-0.69 -3.33 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt1: mod/noi/dif/loss/nce/logp -83.34 /-2.73 /-80.62 / /-0.69 -3.33 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt2: mod/noi/dif/loss/nce/logp -200.86/-12.42 /-188.44/ /-108.51 -100.43/-6.21 3 [bos] nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -294.84/-13.29 /-281.55/ /-201.62 -18.43/-0.83 17 [bos] nothing in english has been [unk] as much as the ambiguous use of words . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.38/-13.74 /-93.64 / /-13.71 -4.30 /-0.55 26 [bos] nothing of english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt5: mod/noi/dif/loss/nce/logp -107.82/-13.44 /-94.38 / /-14.45 -4.31 /-0.54 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it , the ambiguous use of sentences . [eos] cls0 - sp0 : -39.89 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the organized or of preceding . [eos] cls0 - sp1 : -39.93 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the cleaning or of preceding . [eos] cls0 - sp2 : -39.98 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the organized or of expecting . [eos] cls0 - sp3 : -39.98 -1.60 26 0.00 [bos] she in joined has been [unk] as ! as the cleaning all of when , first it be the cleaning or of expecting . [eos] cls0 - sp4 : -39.99 -1.60 26 0.00 [bos] we in joined has been [unk] as ! as the cleaning all of when , first it be the organized or of preceding . [eos] cls1 - sp0 : -50.15 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the cleaning all of when , first it be the cleaning ! of mid-thirties . [eos] cls1 - sp1 : -50.22 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the editor all of when , first it be the cleaning ! of mid-thirties . [eos] cls1 - sp2 : -50.35 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the streets all of when , first it be the cleaning ! of mid-thirties . [eos] cls1 - sp3 : -50.35 -2.01 26 0.28 [bos] we in corner has been [unk] as ! as the cleaning all of when , first it be the editor ! of mid-thirties . [eos] cls1 - sp4 : -50.40 -2.02 26 0.28 [bos] we in corner has been [unk] as ! as the editor all of when , first it be the editor ! of mid-thirties . [eos] cls2 - sp0 : -52.52 -2.10 26 0.72 [bos] we in personal has were [unk] as ! as the telephone all of when , made it be the bidding or of mississippi . [eos] cls2 - sp1 : -52.52 -2.10 26 0.72 [bos] we in personal has were [unk] as ! as the telephone all of when , made it be the bidding or of telephone . [eos] cls2 - sp2 : -52.55 -2.10 26 0.72 [bos] we in personal has been [unk] as ! as the telephone all of when , made it be the bidding or of mississippi . [eos] cls2 - sp3 : -52.67 -2.11 26 0.68 [bos] we in personal has were [unk] as ! as the telephone all of when , made it be the bidding or of telephone . [eos] cls2 - sp4 : -52.67 -2.11 26 0.72 [bos] we in personal has were [unk] as ! as the telephone all of when , don't it be the bidding or of mississippi . [eos] cls3 - sp0 : -40.07 -1.60 26 1.00 [bos] we in personal has been [unk] as ! as the telephone all of when , first it be the telephone or of mississippi . [eos] cls3 - sp1 : -40.13 -1.61 26 1.00 [bos] we in personal has been [unk] as much as the telephone all of when , first it be the telephone or of mississippi . [eos] cls3 - sp2 : -40.14 -1.61 26 1.00 [bos] we in personal has been [unk] as ! as the telephone all of when , made it be the telephone or of mississippi . [eos] cls3 - sp3 : -40.19 -1.61 26 1.00 [bos] we in situation has been [unk] as ! as the telephone all of when , first it be the telephone or of mississippi . [eos] cls3 - sp4 : -40.20 -1.61 26 1.00 [bos] we in personal has been [unk] as ! as the telephone all of when , first it be the telephone or of telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-294 src: none none 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt0: mod/noi/dif/loss/nce/logp -85.83 /-2.73 /-83.10 /0.69/-0.69 -3.43 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt1: mod/noi/dif/loss/nce/logp -85.83 /-2.73 /-83.10 / /-0.69 -3.43 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt2: mod/noi/dif/loss/nce/logp -205.65/-12.42 /-193.23/ /-110.82 -102.83/-6.21 3 [bos] nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -304.70/-13.29 /-291.41/ /-209.00 -19.04/-0.83 17 [bos] nothing in english has been [unk] as much as the ambiguous use of words . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.84/-13.74 /-94.10 / /-11.69 -4.31 /-0.55 26 [bos] nothing of english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt5: mod/noi/dif/loss/nce/logp -110.40/-13.44 /-96.96 / /-14.55 -4.42 /-0.54 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it , the ambiguous use of sentences . [eos] cls0 - sp0 : -42.70 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the organized no of joined . [eos] cls0 - sp1 : -42.73 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the deck no of joined . [eos] cls0 - sp2 : -42.75 -1.71 26 0.00 [bos] she in first has been [unk] as other as the streets all of when , preceding it be the streets no of joined . [eos] cls0 - sp3 : -42.76 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the cleaning no of joined . [eos] cls0 - sp4 : -42.78 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the streets no of joined . [eos] cls1 - sp0 : -52.88 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the cleaning all of when , cleaning it be the cleaning no of couldn't . [eos] cls1 - sp1 : -52.88 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the cleaning all of when , cleaning it be the deck no of couldn't . [eos] cls1 - sp2 : -52.89 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the editor all of when , cleaning it be the cleaning no of couldn't . [eos] cls1 - sp3 : -52.90 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the editor all of when , cleaning it be the deck no of couldn't . [eos] cls1 - sp4 : -52.94 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the streets all of when , cleaning it be the cleaning no of couldn't . [eos] cls2 - sp0 : -53.16 -2.13 26 0.68 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the bidding no of corner . [eos] cls2 - sp1 : -53.29 -2.13 26 0.68 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the laughed no of corner . [eos] cls2 - sp2 : -53.29 -2.13 26 0.72 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the laughed no of corner . [eos] cls2 - sp3 : -53.31 -2.13 26 0.72 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the receiving no of corner . [eos] cls2 - sp4 : -53.31 -2.13 26 0.72 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the bidding no of corner . [eos] cls3 - sp0 : -43.62 -1.74 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of when , streets it be the housing no of corner . [eos] cls3 - sp1 : -43.62 -1.74 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of when , streets it be the state no of corner . [eos] cls3 - sp2 : -43.64 -1.75 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of when , reliable it be the housing no of corner . [eos] cls3 - sp3 : -43.70 -1.75 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of all , streets it be the state no of corner . [eos] cls3 - sp4 : -43.74 -1.75 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of all , streets it be the housing no of corner . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-295 src: none none 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt0: mod/noi/dif/loss/nce/logp -84.79 /-2.73 /-82.06 /0.69/-0.69 -3.39 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt1: mod/noi/dif/loss/nce/logp -84.79 /-2.73 /-82.06 / /-0.69 -3.39 /-0.11 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt2: mod/noi/dif/loss/nce/logp -201.28/-12.42 /-188.86/ /-107.49 -100.64/-6.21 3 [bos] nothing [eos] tgt3: mod/noi/dif/loss/nce/logp -295.70/-13.29 /-282.40/ /-201.03 -18.48/-0.83 17 [bos] nothing in english has been [unk] as much as the ambiguous use of words . [eos] tgt4: mod/noi/dif/loss/nce/logp -108.54/-13.74 /-94.80 / /-13.43 -4.34 /-0.55 26 [bos] nothing of english has been [unk] as much as the ambiguous use of words , unless it be the ambiguous use of sentences . [eos] tgt5: mod/noi/dif/loss/nce/logp -108.61/-13.44 /-95.17 / /-13.80 -4.34 /-0.54 26 [bos] nothing in english has been [unk] as much as the ambiguous use of words , unless it , the ambiguous use of sentences . [eos] cls0 - sp0 : -42.70 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the organized no of joined . [eos] cls0 - sp1 : -42.73 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the deck no of joined . [eos] cls0 - sp2 : -42.75 -1.71 26 0.00 [bos] she in first has been [unk] as other as the streets all of when , preceding it be the streets no of joined . [eos] cls0 - sp3 : -42.76 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the cleaning no of joined . [eos] cls0 - sp4 : -42.78 -1.71 26 0.00 [bos] she in first has been [unk] as ! as the streets all of when , preceding it be the streets no of joined . [eos] cls1 - sp0 : -52.88 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the cleaning all of when , cleaning it be the cleaning no of couldn't . [eos] cls1 - sp1 : -52.88 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the cleaning all of when , cleaning it be the deck no of couldn't . [eos] cls1 - sp2 : -52.89 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the editor all of when , cleaning it be the cleaning no of couldn't . [eos] cls1 - sp3 : -52.90 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the editor all of when , cleaning it be the deck no of couldn't . [eos] cls1 - sp4 : -52.94 -2.12 26 0.28 [bos] she in don't has been [unk] as ! as the streets all of when , cleaning it be the cleaning no of couldn't . [eos] cls2 - sp0 : -53.16 -2.13 26 0.68 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the bidding no of corner . [eos] cls2 - sp1 : -53.29 -2.13 26 0.68 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the laughed no of corner . [eos] cls2 - sp2 : -53.29 -2.13 26 0.72 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the laughed no of corner . [eos] cls2 - sp3 : -53.31 -2.13 26 0.72 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the receiving no of corner . [eos] cls2 - sp4 : -53.31 -2.13 26 0.72 [bos] she in don't has been [unk] as ! as the telephone all of when , reliable it be the bidding no of corner . [eos] cls3 - sp0 : -43.62 -1.74 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of when , streets it be the housing no of corner . [eos] cls3 - sp1 : -43.62 -1.74 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of when , streets it be the state no of corner . [eos] cls3 - sp2 : -43.64 -1.75 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of when , reliable it be the housing no of corner . [eos] cls3 - sp3 : -43.70 -1.75 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of all , streets it be the state no of corner . [eos] cls3 - sp4 : -43.74 -1.75 26 1.00 [bos] we in first has been [unk] as ! as the telephone all of all , streets it be the housing no of corner . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-296 src: none none 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -54.49 /-1.06 /-53.43 /6.57/-6.57 -4.95 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -54.49 /-1.06 /-53.43 / /-6.57 -4.95 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -88.39 /-11.91 /-76.47 / /-29.61 -8.84 /-1.19 11 [bos] view takes in five counties , two bedrooms '' [eos] tgt3: mod/noi/dif/loss/nce/logp -137.23/-22.71 /-114.52/ /-67.66 -12.48/-2.06 12 [bos] view takes in five counties , two bedrooms . . [eos] tgt4: mod/noi/dif/loss/nce/logp -92.12 /-12.23 /-79.89 / /-33.03 -7.68 /-1.02 13 [bos] view takes in five counties , two bedrooms '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -59.14 /-12.27 /-46.86 / /-0.00 -5.38 /-1.12 12 [bos] expectations takes in five counties , two bedrooms '' . [eos] cls0 - sp0 : -10.05 -2.01 6 0.20 [bos] ! ! in ! [eos] cls0 - sp1 : -10.78 -2.16 6 0.00 [bos] no couldn't in ! [eos] cls0 - sp2 : -11.00 -2.20 6 0.20 [bos] ! ! in ! [eos] cls0 - sp3 : -11.07 -2.21 6 0.00 [bos] no later in ! [eos] cls0 - sp4 : -11.13 -2.23 6 0.00 [bos] ! ! in ! [eos] cls1 - sp0 : -9.00 -1.80 6 0.40 [bos] ! ! in ! [eos] cls1 - sp1 : -9.64 -1.93 6 0.40 [bos] ! ! in ! [eos] cls1 - sp2 : -9.98 -2.00 6 0.40 [bos] ! ! in ! [eos] cls1 - sp3 : -10.74 -2.15 6 0.40 [bos] ! ! in ! [eos] cls1 - sp4 : -11.91 -2.38 6 0.40 [bos] ! ! in later [eos] cls2 - sp0 : -8.30 -1.66 6 0.60 [bos] ! ! in ! [eos] cls2 - sp1 : -8.75 -1.75 6 0.60 [bos] ! ! in ! [eos] cls2 - sp2 : -8.83 -1.77 6 0.60 [bos] ! ! in ! [eos] cls2 - sp3 : -9.56 -1.91 6 0.60 [bos] ! ! in ! [eos] cls2 - sp4 : -9.79 -1.96 6 0.60 [bos] ! ! in ! [eos] cls3 - sp0 : -7.33 -1.47 6 0.80 [bos] ! ! in ! [eos] cls3 - sp1 : -7.43 -1.49 6 1.00 [bos] ! ! in ! [eos] cls3 - sp2 : -8.44 -1.69 6 0.80 [bos] ! ! in ! [eos] cls3 - sp3 : -8.75 -1.75 6 0.80 [bos] ! ! in ! [eos] cls3 - sp4 : -9.61 -1.92 6 0.80 [bos] ! ! in ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-297 src: none none 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -54.05 /-1.06 /-53.00 /7.16/-7.16 -4.91 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -54.05 /-1.06 /-53.00 / /-7.16 -4.91 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -89.75 /-11.91 /-77.84 / /-32.00 -8.98 /-1.19 11 [bos] view takes in five counties , two bedrooms '' [eos] tgt3: mod/noi/dif/loss/nce/logp -127.03/-22.71 /-104.32/ /-58.49 -11.55/-2.06 12 [bos] view takes in five counties , two bedrooms . . [eos] tgt4: mod/noi/dif/loss/nce/logp -93.28 /-12.23 /-81.05 / /-35.21 -7.77 /-1.02 13 [bos] view takes in five counties , two bedrooms '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.11 /-12.27 /-45.84 / /-0.00 -5.28 /-1.12 12 [bos] expectations takes in five counties , two bedrooms '' . [eos] cls0 - sp0 : -10.05 -2.01 6 0.20 [bos] ! ! in ! [eos] cls0 - sp1 : -10.78 -2.16 6 0.00 [bos] no couldn't in ! [eos] cls0 - sp2 : -11.00 -2.20 6 0.20 [bos] ! ! in ! [eos] cls0 - sp3 : -11.07 -2.21 6 0.00 [bos] no later in ! [eos] cls0 - sp4 : -11.13 -2.23 6 0.00 [bos] ! ! in ! [eos] cls1 - sp0 : -9.00 -1.80 6 0.40 [bos] ! ! in ! [eos] cls1 - sp1 : -9.64 -1.93 6 0.40 [bos] ! ! in ! [eos] cls1 - sp2 : -9.98 -2.00 6 0.40 [bos] ! ! in ! [eos] cls1 - sp3 : -10.74 -2.15 6 0.40 [bos] ! ! in ! [eos] cls1 - sp4 : -11.91 -2.38 6 0.40 [bos] ! ! in later [eos] cls2 - sp0 : -8.30 -1.66 6 0.60 [bos] ! ! in ! [eos] cls2 - sp1 : -8.75 -1.75 6 0.60 [bos] ! ! in ! [eos] cls2 - sp2 : -8.83 -1.77 6 0.60 [bos] ! ! in ! [eos] cls2 - sp3 : -9.56 -1.91 6 0.60 [bos] ! ! in ! [eos] cls2 - sp4 : -9.79 -1.96 6 0.60 [bos] ! ! in ! [eos] cls3 - sp0 : -7.33 -1.47 6 0.80 [bos] ! ! in ! [eos] cls3 - sp1 : -7.43 -1.49 6 1.00 [bos] ! ! in ! [eos] cls3 - sp2 : -8.44 -1.69 6 0.80 [bos] ! ! in ! [eos] cls3 - sp3 : -8.75 -1.75 6 0.80 [bos] ! ! in ! [eos] cls3 - sp4 : -9.61 -1.92 6 0.80 [bos] ! ! in ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-298 src: none none 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -57.07 /-1.06 /-56.01 /6.98/-6.98 -5.19 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -57.07 /-1.06 /-56.01 / /-6.98 -5.19 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -90.23 /-11.91 /-78.32 / /-29.29 -9.02 /-1.19 11 [bos] view takes in five counties , two bedrooms '' [eos] tgt3: mod/noi/dif/loss/nce/logp -127.99/-22.71 /-105.28/ /-56.26 -11.64/-2.06 12 [bos] view takes in five counties , two bedrooms . . [eos] tgt4: mod/noi/dif/loss/nce/logp -93.90 /-12.23 /-81.67 / /-32.64 -7.82 /-1.02 13 [bos] view takes in five counties , two bedrooms '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -61.30 /-12.27 /-49.03 / /-0.00 -5.57 /-1.12 12 [bos] expectations takes in five counties , two bedrooms '' . [eos] cls0 - sp0 : -12.35 -2.47 6 0.20 [bos] no it in ! [eos] cls0 - sp1 : -12.59 -2.52 6 0.20 [bos] no couldn't in ! [eos] cls0 - sp2 : -12.62 -2.52 6 0.20 [bos] no streets in ! [eos] cls0 - sp3 : -12.77 -2.55 6 0.20 [bos] we it in ! [eos] cls0 - sp4 : -12.89 -2.58 6 0.20 [bos] she it in ! [eos] cls1 - sp0 : -13.08 -2.62 6 0.40 [bos] no streets in ! [eos] cls1 - sp1 : -13.15 -2.63 6 0.40 [bos] ! ! in later [eos] cls1 - sp2 : -13.18 -2.64 6 0.40 [bos] ! ! in ! [eos] cls1 - sp3 : -13.23 -2.65 6 0.40 [bos] ! ! in ! [eos] cls1 - sp4 : -13.46 -2.69 6 0.40 [bos] ! ! in ! [eos] cls2 - sp0 : -12.04 -2.41 6 0.60 [bos] ! ! in ! [eos] cls2 - sp1 : -13.02 -2.60 6 0.60 [bos] ! ! in ! [eos] cls2 - sp2 : -13.08 -2.62 6 0.60 [bos] ! ! in later [eos] cls2 - sp3 : -15.23 -3.05 6 0.60 [bos] ! ! in later [eos] cls2 - sp4 : -15.41 -3.08 6 0.60 [bos] ! ! in ! [eos] cls3 - sp0 : -9.77 -1.95 6 1.00 [bos] ! ! in ! [eos] cls3 - sp1 : -10.92 -2.18 6 0.80 [bos] ! ! in ! [eos] cls3 - sp2 : -13.10 -2.62 6 0.80 [bos] ! ! in later [eos] cls3 - sp3 : -19.18 -1.74 12 0.91 [bos] ! ! in later ! , ! ! '' . [eos] cls3 - sp4 : -19.80 -1.80 12 1.00 [bos] ! ! in later ! , ! ! '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-299 src: none none 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -56.69 /-1.06 /-55.63 /7.65/-7.65 -5.15 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -56.69 /-1.06 /-55.63 / /-7.65 -5.15 /-0.10 12 [bos] view takes in five counties , two bedrooms '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -90.62 /-11.91 /-78.70 / /-30.73 -9.06 /-1.19 11 [bos] view takes in five counties , two bedrooms '' [eos] tgt3: mod/noi/dif/loss/nce/logp -119.87/-22.71 /-97.16 / /-49.18 -10.90/-2.06 12 [bos] view takes in five counties , two bedrooms . . [eos] tgt4: mod/noi/dif/loss/nce/logp -95.34 /-12.23 /-83.11 / /-35.13 -7.95 /-1.02 13 [bos] view takes in five counties , two bedrooms '' . . [eos] tgt5: mod/noi/dif/loss/nce/logp -60.25 /-12.27 /-47.98 / /-0.00 -5.48 /-1.12 12 [bos] expectations takes in five counties , two bedrooms '' . [eos] cls0 - sp0 : -12.35 -2.47 6 0.20 [bos] no it in ! [eos] cls0 - sp1 : -12.59 -2.52 6 0.20 [bos] no couldn't in ! [eos] cls0 - sp2 : -12.62 -2.52 6 0.20 [bos] no streets in ! [eos] cls0 - sp3 : -12.77 -2.55 6 0.20 [bos] we it in ! [eos] cls0 - sp4 : -12.89 -2.58 6 0.20 [bos] she it in ! [eos] cls1 - sp0 : -13.08 -2.62 6 0.40 [bos] no streets in ! [eos] cls1 - sp1 : -13.15 -2.63 6 0.40 [bos] ! ! in later [eos] cls1 - sp2 : -13.18 -2.64 6 0.40 [bos] ! ! in ! [eos] cls1 - sp3 : -13.23 -2.65 6 0.40 [bos] ! ! in ! [eos] cls1 - sp4 : -13.46 -2.69 6 0.40 [bos] ! ! in ! [eos] cls2 - sp0 : -12.04 -2.41 6 0.60 [bos] ! ! in ! [eos] cls2 - sp1 : -13.02 -2.60 6 0.60 [bos] ! ! in ! [eos] cls2 - sp2 : -13.08 -2.62 6 0.60 [bos] ! ! in later [eos] cls2 - sp3 : -15.23 -3.05 6 0.60 [bos] ! ! in later [eos] cls2 - sp4 : -15.41 -3.08 6 0.60 [bos] ! ! in ! [eos] cls3 - sp0 : -9.77 -1.95 6 1.00 [bos] ! ! in ! [eos] cls3 - sp1 : -10.92 -2.18 6 0.80 [bos] ! ! in ! [eos] cls3 - sp2 : -13.10 -2.62 6 0.80 [bos] ! ! in later [eos] cls3 - sp3 : -19.18 -1.74 12 0.91 [bos] ! ! in later ! , ! ! '' . [eos] cls3 - sp4 : -19.80 -1.80 12 1.00 [bos] ! ! in later ! , ! ! '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-300 src: none none 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -130.00/-2.89 /-127.11/0.69/-0.69 -4.48 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -130.00/-2.89 /-127.11/ /-0.69 -4.48 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -230.98/-11.92 /-219.07/ /-92.65 -15.40/-0.79 16 [bos] an item in the letters column of a newspaper renewed a subscription , adding [eos] tgt3: mod/noi/dif/loss/nce/logp -168.43/-13.80 /-154.64/ /-28.22 -6.02 /-0.49 29 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' [eos] tgt4: mod/noi/dif/loss/nce/logp -153.95/-13.91 /-140.03/ /-13.62 -5.31 /-0.48 30 [bos] an item in the letters column of the newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -154.61/-13.86 /-140.75/ /-14.33 -5.33 /-0.48 30 [bos] an item in the letters column of a newspaper renewed the subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] cls0 - sp0 : -65.43 -2.26 30 0.03 [bos] it streets in the ( preceding of a streets . is , , streets '' `` i delivering streets or deck as but as no over '' . [eos] cls0 - sp1 : -65.44 -2.26 30 0.03 [bos] it streets in the ( preceding of a streets . is , , joined '' `` i delivering streets or deck as ! as no over '' . [eos] cls0 - sp2 : -65.44 -2.26 30 0.03 [bos] ( streets in the million joined of a streets . is , , joined '' `` i delivering streets or deck as ! as no over '' . [eos] cls0 - sp3 : -65.44 -2.26 30 0.03 [bos] ( streets in the million joined of a streets . is , , streets '' `` i delivering streets or deck as but as no over '' . [eos] cls0 - sp4 : -65.45 -2.26 30 0.03 [bos] it streets in the ( preceding of a streets . is , , joined '' `` i delivering streets or deck as but as no over '' . [eos] cls1 - sp0 : -75.52 -2.60 30 0.28 [bos] it streets in the ( joined of a telephone . is , , joined '' `` i telephone firms or i as ! as no over '' . [eos] cls1 - sp1 : -75.60 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , editor '' `` i telephone firms or i as ! as no over '' . [eos] cls1 - sp2 : -75.67 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , joined '' `` i telephone firms or i as ! as we over '' . [eos] cls1 - sp3 : -75.69 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , joined '' `` i telephone firms or i as ! as no made '' . [eos] cls1 - sp4 : -75.71 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , editor '' `` i telephone firms or i as ! as no made '' . [eos] cls2 - sp0 : -76.08 -2.62 30 0.69 [bos] '' streets in the ( crime of a telephone made a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp1 : -76.10 -2.62 30 0.69 [bos] '' streets in the ( crime of a telephone discussed a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp2 : -76.18 -2.63 30 0.66 [bos] '' streets in the ( crime of a telephone discussed a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp3 : -76.18 -2.63 30 0.66 [bos] '' streets in the ( crime of a telephone made a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp4 : -77.40 -2.67 30 0.62 [bos] '' streets in the ( crime of a telephone discussed a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls3 - sp0 : -68.69 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or state as ! as be state '' . [eos] cls3 - sp1 : -68.71 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or streets as ! as be state '' . [eos] cls3 - sp2 : -68.71 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or state as ! as be do '' . [eos] cls3 - sp3 : -68.74 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or streets as ! as be do '' . [eos] cls3 - sp4 : -68.74 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or state as when as be state '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-301 src: none none 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -131.96/-2.89 /-129.07/0.69/-0.69 -4.55 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -131.96/-2.89 /-129.07/ /-0.69 -4.55 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -226.83/-11.92 /-214.92/ /-86.54 -15.12/-0.79 16 [bos] an item in the letters column of a newspaper renewed a subscription , adding [eos] tgt3: mod/noi/dif/loss/nce/logp -175.79/-13.80 /-162.00/ /-33.62 -6.28 /-0.49 29 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' [eos] tgt4: mod/noi/dif/loss/nce/logp -155.53/-13.91 /-141.62/ /-13.24 -5.36 /-0.48 30 [bos] an item in the letters column of the newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -157.11/-13.86 /-143.24/ /-14.87 -5.42 /-0.48 30 [bos] an item in the letters column of a newspaper renewed the subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] cls0 - sp0 : -65.43 -2.26 30 0.03 [bos] it streets in the ( preceding of a streets . is , , streets '' `` i delivering streets or deck as but as no over '' . [eos] cls0 - sp1 : -65.44 -2.26 30 0.03 [bos] it streets in the ( preceding of a streets . is , , joined '' `` i delivering streets or deck as ! as no over '' . [eos] cls0 - sp2 : -65.44 -2.26 30 0.03 [bos] ( streets in the million joined of a streets . is , , joined '' `` i delivering streets or deck as ! as no over '' . [eos] cls0 - sp3 : -65.44 -2.26 30 0.03 [bos] ( streets in the million joined of a streets . is , , streets '' `` i delivering streets or deck as but as no over '' . [eos] cls0 - sp4 : -65.45 -2.26 30 0.03 [bos] it streets in the ( preceding of a streets . is , , joined '' `` i delivering streets or deck as but as no over '' . [eos] cls1 - sp0 : -75.52 -2.60 30 0.28 [bos] it streets in the ( joined of a telephone . is , , joined '' `` i telephone firms or i as ! as no over '' . [eos] cls1 - sp1 : -75.60 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , editor '' `` i telephone firms or i as ! as no over '' . [eos] cls1 - sp2 : -75.67 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , joined '' `` i telephone firms or i as ! as we over '' . [eos] cls1 - sp3 : -75.69 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , joined '' `` i telephone firms or i as ! as no made '' . [eos] cls1 - sp4 : -75.71 -2.61 30 0.28 [bos] it streets in the ( joined of a telephone . is , , editor '' `` i telephone firms or i as ! as no made '' . [eos] cls2 - sp0 : -76.08 -2.62 30 0.69 [bos] '' streets in the ( crime of a telephone made a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp1 : -76.10 -2.62 30 0.69 [bos] '' streets in the ( crime of a telephone discussed a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp2 : -76.18 -2.63 30 0.66 [bos] '' streets in the ( crime of a telephone discussed a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp3 : -76.18 -2.63 30 0.66 [bos] '' streets in the ( crime of a telephone made a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls2 - sp4 : -77.40 -2.67 30 0.62 [bos] '' streets in the ( crime of a telephone discussed a bidding , corner '' `` i telephone did are streets as ! as no over '' . [eos] cls3 - sp0 : -68.69 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or state as ! as be state '' . [eos] cls3 - sp1 : -68.71 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or streets as ! as be state '' . [eos] cls3 - sp2 : -68.71 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or state as ! as be do '' . [eos] cls3 - sp3 : -68.74 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or streets as ! as be do '' . [eos] cls3 - sp4 : -68.74 -2.37 30 0.93 [bos] '' streets in the ( mississippi of a streets made a , , corner '' `` i telephone streets or state as when as be state '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-302 src: none none 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -131.79/-2.89 /-128.90/0.69/-0.69 -4.54 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -131.79/-2.89 /-128.90/ /-0.69 -4.54 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -249.87/-11.92 /-237.95/ /-109.75 -16.66/-0.79 16 [bos] an item in the letters column of a newspaper renewed a subscription , adding [eos] tgt3: mod/noi/dif/loss/nce/logp -168.77/-13.80 /-154.97/ /-26.77 -6.03 /-0.49 29 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' [eos] tgt4: mod/noi/dif/loss/nce/logp -155.23/-13.91 /-141.32/ /-13.11 -5.35 /-0.48 30 [bos] an item in the letters column of the newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -155.92/-13.86 /-142.05/ /-13.85 -5.38 /-0.48 30 [bos] an item in the letters column of a newspaper renewed the subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] cls0 - sp0 : -64.96 -2.24 30 0.00 [bos] ( streets in the world rome of a streets cleaning a cleaning , first : `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp1 : -65.00 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a organized , first : `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp2 : -65.01 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a cleaning , first : `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp3 : -65.02 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a organized , first '' `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp4 : -65.03 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a cleaning , first '' `` i delivering streets when streets as but as any expecting '' . [eos] cls1 - sp0 : -67.17 -2.58 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as any [eos] cls1 - sp1 : -67.38 -2.59 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering ( when streets as but as any [eos] cls1 - sp2 : -67.44 -2.59 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as be [eos] cls1 - sp3 : -67.53 -2.60 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as no [eos] cls1 - sp4 : -71.01 -2.45 30 0.28 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as any preceding '' . [eos] cls2 - sp0 : -69.94 -2.69 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as ; as be [eos] cls2 - sp1 : -70.06 -2.69 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as ; as any [eos] cls2 - sp2 : -70.22 -2.70 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as but as be [eos] cls2 - sp3 : -70.33 -2.70 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as but as any [eos] cls2 - sp4 : -70.42 -2.71 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as but as no [eos] cls3 - sp0 : -67.59 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone telephone a telephone , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp1 : -67.61 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone mississippi a telephone , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp2 : -67.62 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone telephone a sponsored , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp3 : -67.66 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone mississippi a sponsored , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp4 : -67.79 -2.34 30 0.93 [bos] ( streets in the were personal of a telephone telephone a telephone , first : `` i mississippi did when streets as but as be streets '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-303 src: none none 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -131.41/-2.89 /-128.52/0.69/-0.69 -4.53 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -131.41/-2.89 /-128.52/ /-0.69 -4.53 /-0.10 30 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -250.93/-11.92 /-239.01/ /-111.18 -16.73/-0.79 16 [bos] an item in the letters column of a newspaper renewed a subscription , adding [eos] tgt3: mod/noi/dif/loss/nce/logp -173.68/-13.80 /-159.89/ /-32.06 -6.20 /-0.49 29 [bos] an item in the letters column of a newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' [eos] tgt4: mod/noi/dif/loss/nce/logp -154.59/-13.91 /-140.68/ /-12.85 -5.33 /-0.48 30 [bos] an item in the letters column of the newspaper renewed a subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -156.25/-13.86 /-142.39/ /-14.56 -5.39 /-0.48 30 [bos] an item in the letters column of a newspaper renewed the subscription , adding : `` i personally enjoy your newspaper as much as my husband '' . [eos] cls0 - sp0 : -64.96 -2.24 30 0.00 [bos] ( streets in the world rome of a streets cleaning a cleaning , first : `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp1 : -65.00 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a organized , first : `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp2 : -65.01 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a cleaning , first : `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp3 : -65.02 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a organized , first '' `` i delivering streets when streets as but as any expecting '' . [eos] cls0 - sp4 : -65.03 -2.24 30 0.00 [bos] ( streets in the world preceding of a streets cleaning a cleaning , first '' `` i delivering streets when streets as but as any expecting '' . [eos] cls1 - sp0 : -67.17 -2.58 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as any [eos] cls1 - sp1 : -67.38 -2.59 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering ( when streets as but as any [eos] cls1 - sp2 : -67.44 -2.59 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as be [eos] cls1 - sp3 : -67.53 -2.60 27 0.31 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as no [eos] cls1 - sp4 : -71.01 -2.45 30 0.28 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i delivering streets when streets as but as any preceding '' . [eos] cls2 - sp0 : -69.94 -2.69 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as ; as be [eos] cls2 - sp1 : -70.06 -2.69 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as ; as any [eos] cls2 - sp2 : -70.22 -2.70 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as but as be [eos] cls2 - sp3 : -70.33 -2.70 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as but as any [eos] cls2 - sp4 : -70.42 -2.71 27 0.54 [bos] ( streets in the streets crime of a telephone telephone a telephone , couldn't : `` i discussed did when telephone as but as no [eos] cls3 - sp0 : -67.59 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone telephone a telephone , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp1 : -67.61 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone mississippi a telephone , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp2 : -67.62 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone telephone a sponsored , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp3 : -67.66 -2.33 30 0.93 [bos] ( streets in the were personal of a telephone mississippi a sponsored , first : `` i telephone did when streets as but as be streets '' . [eos] cls3 - sp4 : -67.79 -2.34 30 0.93 [bos] ( streets in the were personal of a telephone telephone a telephone , first : `` i mississippi did when streets as but as be streets '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-304 src: none none 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -33.10 /-0.95 /-32.15 /0.77/-0.77 -3.68 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -33.10 /-0.95 /-32.15 / /-0.77 -3.68 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -50.90 /-11.53 /-39.37 / /-7.99 -5.66 /-1.28 10 [bos] his kissed him passionately upon his [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -56.06 /-12.80 /-43.26 / /-11.89 -6.23 /-1.42 10 [bos] she kissed him passionately upon fifty [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -64.54 /-11.86 /-52.68 / /-21.31 -8.07 /-1.48 9 [bos] she kissed him passionately upon his [unk] [eos] tgt5: mod/noi/dif/loss/nce/logp -45.37 /-11.44 /-33.93 / /-2.55 -5.04 /-1.27 10 [bos] `` kissed him passionately upon his [unk] . [eos] cls0 - sp0 : -6.61 -3.30 3 0.00 [bos] ! [eos] cls0 - sp1 : -18.46 -2.05 10 0.00 [bos] she pain but later than his [unk] . [eos] cls0 - sp2 : -18.51 -2.06 10 0.00 [bos] she no but later than his [unk] . [eos] cls0 - sp3 : -18.51 -2.06 10 0.00 [bos] she pain but mean than his [unk] . [eos] cls0 - sp4 : -18.58 -2.06 10 0.00 [bos] she pain but ! about his [unk] . [eos] cls1 - sp0 : -9.94 -2.48 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -10.92 -2.73 5 0.25 [bos] ! ! ; [eos] cls1 - sp2 : -11.08 -2.77 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -11.40 -2.85 5 0.25 [bos] she 7 ; [eos] cls1 - sp4 : -15.82 -3.96 5 0.25 [bos] she 7 but [eos] cls2 - sp0 : -7.97 -3.98 3 0.50 [bos] ! [eos] cls2 - sp1 : -9.10 -2.27 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -9.79 -2.45 5 0.50 [bos] ! ! ; [eos] cls2 - sp3 : -10.58 -2.65 5 0.50 [bos] ! ! ! [eos] cls2 - sp4 : -12.63 -3.16 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -9.59 -2.40 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -10.97 -2.74 5 1.00 [bos] ! ! ! [eos] cls3 - sp2 : -11.11 -2.78 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -12.55 -3.14 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -12.65 -3.16 5 0.75 [bos] ! ! ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-305 src: none none 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -31.80 /-0.95 /-30.86 /0.74/-0.74 -3.53 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -31.80 /-0.95 /-30.86 / /-0.74 -3.53 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -49.36 /-11.53 /-37.83 / /-7.71 -5.48 /-1.28 10 [bos] his kissed him passionately upon his [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -58.10 /-12.80 /-45.30 / /-15.18 -6.46 /-1.42 10 [bos] she kissed him passionately upon fifty [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -68.36 /-11.86 /-56.50 / /-26.38 -8.55 /-1.48 9 [bos] she kissed him passionately upon his [unk] [eos] tgt5: mod/noi/dif/loss/nce/logp -44.76 /-11.44 /-33.32 / /-3.20 -4.97 /-1.27 10 [bos] `` kissed him passionately upon his [unk] . [eos] cls0 - sp0 : -6.61 -3.30 3 0.00 [bos] ! [eos] cls0 - sp1 : -18.46 -2.05 10 0.00 [bos] she pain but later than his [unk] . [eos] cls0 - sp2 : -18.51 -2.06 10 0.00 [bos] she no but later than his [unk] . [eos] cls0 - sp3 : -18.51 -2.06 10 0.00 [bos] she pain but mean than his [unk] . [eos] cls0 - sp4 : -18.58 -2.06 10 0.00 [bos] she pain but ! about his [unk] . [eos] cls1 - sp0 : -9.94 -2.48 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -10.92 -2.73 5 0.25 [bos] ! ! ; [eos] cls1 - sp2 : -11.08 -2.77 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -11.40 -2.85 5 0.25 [bos] she 7 ; [eos] cls1 - sp4 : -15.82 -3.96 5 0.25 [bos] she 7 but [eos] cls2 - sp0 : -7.97 -3.98 3 0.50 [bos] ! [eos] cls2 - sp1 : -9.10 -2.27 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -9.79 -2.45 5 0.50 [bos] ! ! ; [eos] cls2 - sp3 : -10.58 -2.65 5 0.50 [bos] ! ! ! [eos] cls2 - sp4 : -12.63 -3.16 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -9.59 -2.40 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -10.97 -2.74 5 1.00 [bos] ! ! ! [eos] cls3 - sp2 : -11.11 -2.78 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -12.55 -3.14 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -12.65 -3.16 5 0.75 [bos] ! ! ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-306 src: none none 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -36.92 /-0.95 /-35.98 /0.73/-0.73 -4.10 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -36.92 /-0.95 /-35.98 / /-0.73 -4.10 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -55.73 /-11.53 /-44.20 / /-8.95 -6.19 /-1.28 10 [bos] his kissed him passionately upon his [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -57.81 /-12.80 /-45.02 / /-9.77 -6.42 /-1.42 10 [bos] she kissed him passionately upon fifty [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -67.35 /-11.86 /-55.49 / /-20.24 -8.42 /-1.48 9 [bos] she kissed him passionately upon his [unk] [eos] tgt5: mod/noi/dif/loss/nce/logp -50.13 /-11.44 /-38.69 / /-3.44 -5.57 /-1.27 10 [bos] `` kissed him passionately upon his [unk] . [eos] cls0 - sp0 : -10.68 -2.67 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -12.25 -1.36 10 0.22 [bos] ! ! ! ! ! his [unk] . [eos] cls0 - sp2 : -12.81 -1.42 10 0.22 [bos] ! ! ! ! ! his [unk] . [eos] cls0 - sp3 : -12.91 -1.43 10 0.22 [bos] ! ! ! ! ! his [unk] . [eos] cls0 - sp4 : -13.05 -1.45 10 0.11 [bos] ! ! ! ! ! his [unk] . [eos] cls1 - sp0 : -10.28 -2.57 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -10.86 -2.72 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -11.01 -1.22 10 0.44 [bos] ! ! ! ! ! his [unk] . [eos] cls1 - sp3 : -11.35 -1.26 10 0.44 [bos] ! ! ! ! ! his [unk] . [eos] cls1 - sp4 : -11.44 -1.27 10 0.44 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp0 : -9.46 -2.36 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -10.44 -1.16 10 0.56 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp2 : -10.64 -1.18 10 0.67 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp3 : -10.74 -1.19 10 0.67 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp4 : -10.90 -1.21 10 0.67 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp0 : -9.82 -1.09 10 0.89 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp1 : -9.96 -1.11 10 0.78 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp2 : -10.08 -2.52 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -10.77 -1.20 10 0.78 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp4 : -11.03 -1.23 10 1.00 [bos] ! ! ! ! ! his [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-307 src: none none 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.02 /-0.95 /-33.07 /0.71/-0.71 -3.78 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.02 /-0.95 /-33.07 / /-0.71 -3.78 /-0.11 10 [bos] she kissed him passionately upon his [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -52.86 /-11.53 /-41.33 / /-8.97 -5.87 /-1.28 10 [bos] his kissed him passionately upon his [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -58.93 /-12.80 /-46.13 / /-13.77 -6.55 /-1.42 10 [bos] she kissed him passionately upon fifty [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.12 /-11.86 /-58.26 / /-25.91 -8.77 /-1.48 9 [bos] she kissed him passionately upon his [unk] [eos] tgt5: mod/noi/dif/loss/nce/logp -47.77 /-11.44 /-36.33 / /-3.97 -5.31 /-1.27 10 [bos] `` kissed him passionately upon his [unk] . [eos] cls0 - sp0 : -10.68 -2.67 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -12.25 -1.36 10 0.22 [bos] ! ! ! ! ! his [unk] . [eos] cls0 - sp2 : -12.81 -1.42 10 0.22 [bos] ! ! ! ! ! his [unk] . [eos] cls0 - sp3 : -12.91 -1.43 10 0.22 [bos] ! ! ! ! ! his [unk] . [eos] cls0 - sp4 : -13.05 -1.45 10 0.11 [bos] ! ! ! ! ! his [unk] . [eos] cls1 - sp0 : -10.28 -2.57 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -10.86 -2.72 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -11.01 -1.22 10 0.44 [bos] ! ! ! ! ! his [unk] . [eos] cls1 - sp3 : -11.35 -1.26 10 0.44 [bos] ! ! ! ! ! his [unk] . [eos] cls1 - sp4 : -11.44 -1.27 10 0.44 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp0 : -9.46 -2.36 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -10.44 -1.16 10 0.56 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp2 : -10.64 -1.18 10 0.67 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp3 : -10.74 -1.19 10 0.67 [bos] ! ! ! ! ! his [unk] . [eos] cls2 - sp4 : -10.90 -1.21 10 0.67 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp0 : -9.82 -1.09 10 0.89 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp1 : -9.96 -1.11 10 0.78 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp2 : -10.08 -2.52 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -10.77 -1.20 10 0.78 [bos] ! ! ! ! ! his [unk] . [eos] cls3 - sp4 : -11.03 -1.23 10 1.00 [bos] ! ! ! ! ! his [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-308 src: none none 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt0: mod/noi/dif/loss/nce/logp -86.71 /-1.85 /-84.86 /14.15/-14.15 -4.82 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt1: mod/noi/dif/loss/nce/logp -86.71 /-1.85 /-84.86 / /-14.15 -4.82 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt2: mod/noi/dif/loss/nce/logp -84.40 /-13.68 /-70.72 / /-0.00 -4.69 /-0.76 19 [bos] this windshield was a failure in the dress department and was transferred to the shoe department . [eos] tgt3: mod/noi/dif/loss/nce/logp -122.80/-12.75 /-110.05/ /-39.33 -7.22 /-0.75 18 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department [eos] tgt4: mod/noi/dif/loss/nce/logp -89.74 /-13.53 /-76.21 / /-5.49 -4.99 /-0.75 19 [bos] this saleslady was a failure in the dress department and was transferred to the broadway department . [eos] tgt5: mod/noi/dif/loss/nce/logp -92.57 /-14.09 /-78.48 / /-7.76 -5.14 /-0.78 19 [bos] this saleslady was a failure in the dress department and was transferred to the eliminating department . [eos] cls0 - sp0 : -34.37 -1.91 19 0.00 [bos] i couldn't was a streets in the later ! and was cleaning to the joined ! . [eos] cls0 - sp1 : -34.38 -1.91 19 0.00 [bos] i couldn't was a streets in the later ! and was bidding to the joined i . [eos] cls0 - sp2 : -34.40 -1.91 19 0.00 [bos] i joined was a streets in the later ! and was bidding to the she united . [eos] cls0 - sp3 : -34.41 -1.91 19 0.00 [bos] i couldn't was a streets in the later ! and was bidding to the she united . [eos] cls0 - sp4 : -34.41 -1.91 19 0.00 [bos] i joined was a streets in the later ! and was bidding to the joined i . [eos] cls1 - sp0 : -36.69 -2.04 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the first ! . [eos] cls1 - sp1 : -36.70 -2.04 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the she ! . [eos] cls1 - sp2 : -36.74 -2.04 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the editor ! . [eos] cls1 - sp3 : -36.82 -2.05 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the she i . [eos] cls1 - sp4 : -36.91 -2.05 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the cleaning ! . [eos] cls2 - sp0 : -38.12 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone ! . [eos] cls2 - sp1 : -38.12 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone ! . [eos] cls2 - sp2 : -38.22 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone when . [eos] cls2 - sp3 : -38.22 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone when . [eos] cls2 - sp4 : -38.24 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the thought ! . [eos] cls3 - sp0 : -33.67 -1.87 19 1.00 [bos] ! telephone was a telephone in the later ! and she telephone to the thought thought . [eos] cls3 - sp1 : -33.73 -1.87 19 1.00 [bos] ! telephone was a telephone in the later ! and she telephone to the housing thought . [eos] cls3 - sp2 : -33.76 -1.88 19 1.00 [bos] ! telephone was a telephone in the later ! and she telephone to the telephone thought . [eos] cls3 - sp3 : -33.86 -1.88 19 1.00 [bos] ! 7 was a telephone in the later ! and she telephone to the thought thought . [eos] cls3 - sp4 : -33.91 -1.88 19 1.00 [bos] ! 7 was a telephone in the later ! and she telephone to the housing thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-309 src: none none 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt0: mod/noi/dif/loss/nce/logp -87.61 /-1.85 /-85.77 /15.81/-15.81 -4.87 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt1: mod/noi/dif/loss/nce/logp -87.61 /-1.85 /-85.77 / /-15.81 -4.87 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt2: mod/noi/dif/loss/nce/logp -83.64 /-13.68 /-69.96 / /-0.01 -4.65 /-0.76 19 [bos] this windshield was a failure in the dress department and was transferred to the shoe department . [eos] tgt3: mod/noi/dif/loss/nce/logp -130.67/-12.75 /-117.92/ /-47.96 -7.69 /-0.75 18 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department [eos] tgt4: mod/noi/dif/loss/nce/logp -89.25 /-13.53 /-75.73 / /-5.77 -4.96 /-0.75 19 [bos] this saleslady was a failure in the dress department and was transferred to the broadway department . [eos] tgt5: mod/noi/dif/loss/nce/logp -89.77 /-14.09 /-75.67 / /-5.72 -4.99 /-0.78 19 [bos] this saleslady was a failure in the dress department and was transferred to the eliminating department . [eos] cls0 - sp0 : -34.37 -1.91 19 0.00 [bos] i couldn't was a streets in the later ! and was cleaning to the joined ! . [eos] cls0 - sp1 : -34.38 -1.91 19 0.00 [bos] i couldn't was a streets in the later ! and was bidding to the joined i . [eos] cls0 - sp2 : -34.40 -1.91 19 0.00 [bos] i joined was a streets in the later ! and was bidding to the she united . [eos] cls0 - sp3 : -34.41 -1.91 19 0.00 [bos] i couldn't was a streets in the later ! and was bidding to the she united . [eos] cls0 - sp4 : -34.41 -1.91 19 0.00 [bos] i joined was a streets in the later ! and was bidding to the joined i . [eos] cls1 - sp0 : -36.69 -2.04 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the first ! . [eos] cls1 - sp1 : -36.70 -2.04 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the she ! . [eos] cls1 - sp2 : -36.74 -2.04 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the editor ! . [eos] cls1 - sp3 : -36.82 -2.05 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the she i . [eos] cls1 - sp4 : -36.91 -2.05 19 0.39 [bos] ! telephone was a editor in the ! ! and she bidding to the cleaning ! . [eos] cls2 - sp0 : -38.12 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone ! . [eos] cls2 - sp1 : -38.12 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone ! . [eos] cls2 - sp2 : -38.22 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone when . [eos] cls2 - sp3 : -38.22 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the telephone when . [eos] cls2 - sp4 : -38.24 -2.12 19 0.72 [bos] ! telephone was a editor in the ! ! and she telephone to the thought ! . [eos] cls3 - sp0 : -33.67 -1.87 19 1.00 [bos] ! telephone was a telephone in the later ! and she telephone to the thought thought . [eos] cls3 - sp1 : -33.73 -1.87 19 1.00 [bos] ! telephone was a telephone in the later ! and she telephone to the housing thought . [eos] cls3 - sp2 : -33.76 -1.88 19 1.00 [bos] ! telephone was a telephone in the later ! and she telephone to the telephone thought . [eos] cls3 - sp3 : -33.86 -1.88 19 1.00 [bos] ! 7 was a telephone in the later ! and she telephone to the thought thought . [eos] cls3 - sp4 : -33.91 -1.88 19 1.00 [bos] ! 7 was a telephone in the later ! and she telephone to the housing thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-310 src: none none 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt0: mod/noi/dif/loss/nce/logp -91.87 /-1.85 /-90.02 /13.7/-13.70 -5.10 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt1: mod/noi/dif/loss/nce/logp -91.87 /-1.85 /-90.02 / /-13.70 -5.10 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt2: mod/noi/dif/loss/nce/logp -90.01 /-13.68 /-76.33 / /-0.01 -5.00 /-0.76 19 [bos] this windshield was a failure in the dress department and was transferred to the shoe department . [eos] tgt3: mod/noi/dif/loss/nce/logp -127.75/-12.75 /-115.00/ /-38.68 -7.51 /-0.75 18 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department [eos] tgt4: mod/noi/dif/loss/nce/logp -95.01 /-13.53 /-81.49 / /-5.16 -5.28 /-0.75 19 [bos] this saleslady was a failure in the dress department and was transferred to the broadway department . [eos] tgt5: mod/noi/dif/loss/nce/logp -97.42 /-14.09 /-83.32 / /-7.00 -5.41 /-0.78 19 [bos] this saleslady was a failure in the dress department and was transferred to the eliminating department . [eos] cls0 - sp0 : -32.94 -1.83 19 0.00 [bos] i no was a joined in the any couldn't and she joined to the couldn't all . [eos] cls0 - sp1 : -32.97 -1.83 19 0.00 [bos] i any was a joined in the any couldn't and she couldn't to the couldn't all . [eos] cls0 - sp2 : -32.97 -1.83 19 0.00 [bos] i no was a joined in the any couldn't and was joined to the couldn't all . [eos] cls0 - sp3 : -32.98 -1.83 19 0.00 [bos] i no was a joined in the any couldn't and she couldn't to the couldn't all . [eos] cls0 - sp4 : -32.99 -1.83 19 0.00 [bos] i any was a joined in the any couldn't and she joined to the couldn't all . [eos] cls1 - sp0 : -36.27 -2.01 19 0.33 [bos] no a was a joined in the corner couldn't and she couldn't to the couldn't all . [eos] cls1 - sp1 : -36.40 -2.02 19 0.33 [bos] no a was a joined in the corner couldn't and was couldn't to the couldn't all . [eos] cls1 - sp2 : -36.52 -2.03 19 0.33 [bos] no a was a joined in the corner couldn't and she couldn't to the she all . [eos] cls1 - sp3 : -36.57 -2.03 19 0.33 [bos] no a was a joined in the corner couldn't and was couldn't to the she all . [eos] cls1 - sp4 : -36.70 -2.04 19 0.33 [bos] no a was a joined in the corner couldn't and she couldn't to that couldn't all . [eos] cls2 - sp0 : -39.29 -2.18 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the ! couldn't . [eos] cls2 - sp1 : -39.68 -2.20 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the ! all . [eos] cls2 - sp2 : -39.80 -2.21 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the telephone couldn't . [eos] cls2 - sp3 : -39.92 -2.22 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the don't couldn't . [eos] cls2 - sp4 : -40.12 -2.23 19 0.72 [bos] no a was a joined in the corner couldn't and she telephone to the ! all . [eos] cls3 - sp0 : -33.93 -1.88 19 1.00 [bos] no ) was a later in the corner all and she telephone to the ! all . [eos] cls3 - sp1 : -34.00 -1.89 19 1.00 [bos] no ) was a later in the corner all and she telephone to the telephone all . [eos] cls3 - sp2 : -34.02 -1.89 19 1.00 [bos] no ) was a later in the corner all and she telephone to the don't all . [eos] cls3 - sp3 : -34.05 -1.89 19 1.00 [bos] no ) was a later in the corner all and she telephone to the she all . [eos] cls3 - sp4 : -34.14 -1.90 19 1.00 [bos] no ) was a state in the corner all and she telephone to the don't all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-311 src: none none 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt0: mod/noi/dif/loss/nce/logp -88.38 /-1.85 /-86.53 /15.79/-15.79 -4.91 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt1: mod/noi/dif/loss/nce/logp -88.38 /-1.85 /-86.53 / /-15.79 -4.91 /-0.10 19 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department . [eos] tgt2: mod/noi/dif/loss/nce/logp -84.43 /-13.68 /-70.75 / /-0.01 -4.69 /-0.76 19 [bos] this windshield was a failure in the dress department and was transferred to the shoe department . [eos] tgt3: mod/noi/dif/loss/nce/logp -130.30/-12.75 /-117.55/ /-46.81 -7.66 /-0.75 18 [bos] this saleslady was a failure in the dress department and was transferred to the shoe department [eos] tgt4: mod/noi/dif/loss/nce/logp -89.84 /-13.53 /-76.31 / /-5.57 -4.99 /-0.75 19 [bos] this saleslady was a failure in the dress department and was transferred to the broadway department . [eos] tgt5: mod/noi/dif/loss/nce/logp -90.18 /-14.09 /-76.09 / /-5.35 -5.01 /-0.78 19 [bos] this saleslady was a failure in the dress department and was transferred to the eliminating department . [eos] cls0 - sp0 : -32.94 -1.83 19 0.00 [bos] i no was a joined in the any couldn't and she joined to the couldn't all . [eos] cls0 - sp1 : -32.97 -1.83 19 0.00 [bos] i any was a joined in the any couldn't and she couldn't to the couldn't all . [eos] cls0 - sp2 : -32.97 -1.83 19 0.00 [bos] i no was a joined in the any couldn't and was joined to the couldn't all . [eos] cls0 - sp3 : -32.98 -1.83 19 0.00 [bos] i no was a joined in the any couldn't and she couldn't to the couldn't all . [eos] cls0 - sp4 : -32.99 -1.83 19 0.00 [bos] i any was a joined in the any couldn't and she joined to the couldn't all . [eos] cls1 - sp0 : -36.27 -2.01 19 0.33 [bos] no a was a joined in the corner couldn't and she couldn't to the couldn't all . [eos] cls1 - sp1 : -36.40 -2.02 19 0.33 [bos] no a was a joined in the corner couldn't and was couldn't to the couldn't all . [eos] cls1 - sp2 : -36.52 -2.03 19 0.33 [bos] no a was a joined in the corner couldn't and she couldn't to the she all . [eos] cls1 - sp3 : -36.57 -2.03 19 0.33 [bos] no a was a joined in the corner couldn't and was couldn't to the she all . [eos] cls1 - sp4 : -36.70 -2.04 19 0.33 [bos] no a was a joined in the corner couldn't and she couldn't to that couldn't all . [eos] cls2 - sp0 : -39.29 -2.18 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the ! couldn't . [eos] cls2 - sp1 : -39.68 -2.20 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the ! all . [eos] cls2 - sp2 : -39.80 -2.21 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the telephone couldn't . [eos] cls2 - sp3 : -39.92 -2.22 19 0.61 [bos] no a was a joined in the corner couldn't and she telephone to the don't couldn't . [eos] cls2 - sp4 : -40.12 -2.23 19 0.72 [bos] no a was a joined in the corner couldn't and she telephone to the ! all . [eos] cls3 - sp0 : -33.93 -1.88 19 1.00 [bos] no ) was a later in the corner all and she telephone to the ! all . [eos] cls3 - sp1 : -34.00 -1.89 19 1.00 [bos] no ) was a later in the corner all and she telephone to the telephone all . [eos] cls3 - sp2 : -34.02 -1.89 19 1.00 [bos] no ) was a later in the corner all and she telephone to the don't all . [eos] cls3 - sp3 : -34.05 -1.89 19 1.00 [bos] no ) was a later in the corner all and she telephone to the she all . [eos] cls3 - sp4 : -34.14 -1.90 19 1.00 [bos] no ) was a state in the corner all and she telephone to the don't all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-312 src: none none 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -56.01 /-1.35 /-54.66 /0.69/-0.69 -4.31 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -56.01 /-1.35 /-54.66 / /-0.69 -4.31 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -91.94 /-11.57 /-80.37 / /-26.40 -7.66 /-0.96 13 [bos] `` what are my chances for taking joe's place '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -91.84 /-11.76 /-80.08 / /-26.12 -7.06 /-0.90 14 [bos] `` what are my chances for taking joe's place '' ? . [eos] tgt4: mod/noi/dif/loss/nce/logp -74.24 /-12.20 /-62.04 / /-8.07 -5.71 /-0.94 14 [bos] `` what are my chances , taking joe's place '' ? ? [eos] tgt5: mod/noi/dif/loss/nce/logp -175.93/-12.46 /-163.47/ /-109.50 -17.59/-1.25 11 [bos] `` what are my chances for taking joe's place [eos] cls0 - sp0 : -8.23 -1.65 6 0.00 [bos] '' ) ! ! [eos] cls0 - sp1 : -8.45 -1.69 6 0.00 [bos] : ) ! ! [eos] cls0 - sp2 : -8.48 -1.70 6 0.20 [bos] '' ) ! ! [eos] cls0 - sp3 : -8.48 -1.70 6 0.20 [bos] : ) ! ! [eos] cls0 - sp4 : -8.53 -1.71 6 0.00 [bos] : ? ! ! [eos] cls1 - sp0 : -7.96 -1.59 6 0.40 [bos] '' ) ! ! [eos] cls1 - sp1 : -8.57 -1.71 6 0.40 [bos] : ) ! ! [eos] cls1 - sp2 : -8.62 -1.72 6 0.40 [bos] '' any ! ! [eos] cls1 - sp3 : -8.66 -1.73 6 0.40 [bos] : ? ! ! [eos] cls1 - sp4 : -9.54 -1.91 6 0.40 [bos] : ! ! ! [eos] cls2 - sp0 : -7.75 -1.55 6 0.60 [bos] '' ) ! ! [eos] cls2 - sp1 : -8.13 -1.63 6 0.60 [bos] : ! ! ! [eos] cls2 - sp2 : -8.17 -1.63 6 0.60 [bos] : ) ! ! [eos] cls2 - sp3 : -8.26 -1.65 6 0.60 [bos] '' ! ! ! [eos] cls2 - sp4 : -8.27 -1.65 6 0.60 [bos] '' any ! ! [eos] cls3 - sp0 : -7.76 -1.55 6 0.80 [bos] : ! ! ! [eos] cls3 - sp1 : -7.78 -1.56 6 1.00 [bos] : ! ! ! [eos] cls3 - sp2 : -8.04 -1.61 6 0.80 [bos] '' ! ! ! [eos] cls3 - sp3 : -8.42 -1.68 6 0.80 [bos] `` ! ! ! [eos] cls3 - sp4 : -8.49 -1.70 6 0.80 [bos] : ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-313 src: none none 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -59.86 /-1.35 /-58.51 /0.69/-0.69 -4.60 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -59.86 /-1.35 /-58.51 / /-0.69 -4.60 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -93.78 /-11.57 /-82.21 / /-24.40 -7.82 /-0.96 13 [bos] `` what are my chances for taking joe's place '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -104.44/-11.76 /-92.68 / /-34.87 -8.03 /-0.90 14 [bos] `` what are my chances for taking joe's place '' ? . [eos] tgt4: mod/noi/dif/loss/nce/logp -78.12 /-12.20 /-65.92 / /-8.10 -6.01 /-0.94 14 [bos] `` what are my chances , taking joe's place '' ? ? [eos] tgt5: mod/noi/dif/loss/nce/logp -183.28/-12.46 /-170.82/ /-113.01 -18.33/-1.25 11 [bos] `` what are my chances for taking joe's place [eos] cls0 - sp0 : -8.23 -1.65 6 0.00 [bos] '' ) ! ! [eos] cls0 - sp1 : -8.45 -1.69 6 0.00 [bos] : ) ! ! [eos] cls0 - sp2 : -8.48 -1.70 6 0.20 [bos] '' ) ! ! [eos] cls0 - sp3 : -8.48 -1.70 6 0.20 [bos] : ) ! ! [eos] cls0 - sp4 : -8.53 -1.71 6 0.00 [bos] : ? ! ! [eos] cls1 - sp0 : -7.96 -1.59 6 0.40 [bos] '' ) ! ! [eos] cls1 - sp1 : -8.57 -1.71 6 0.40 [bos] : ) ! ! [eos] cls1 - sp2 : -8.62 -1.72 6 0.40 [bos] '' any ! ! [eos] cls1 - sp3 : -8.66 -1.73 6 0.40 [bos] : ? ! ! [eos] cls1 - sp4 : -9.54 -1.91 6 0.40 [bos] : ! ! ! [eos] cls2 - sp0 : -7.75 -1.55 6 0.60 [bos] '' ) ! ! [eos] cls2 - sp1 : -8.13 -1.63 6 0.60 [bos] : ! ! ! [eos] cls2 - sp2 : -8.17 -1.63 6 0.60 [bos] : ) ! ! [eos] cls2 - sp3 : -8.26 -1.65 6 0.60 [bos] '' ! ! ! [eos] cls2 - sp4 : -8.27 -1.65 6 0.60 [bos] '' any ! ! [eos] cls3 - sp0 : -7.76 -1.55 6 0.80 [bos] : ! ! ! [eos] cls3 - sp1 : -7.78 -1.56 6 1.00 [bos] : ! ! ! [eos] cls3 - sp2 : -8.04 -1.61 6 0.80 [bos] '' ! ! ! [eos] cls3 - sp3 : -8.42 -1.68 6 0.80 [bos] `` ! ! ! [eos] cls3 - sp4 : -8.49 -1.70 6 0.80 [bos] : ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-314 src: none none 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -55.64 /-1.35 /-54.29 /0.69/-0.69 -4.28 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -55.64 /-1.35 /-54.29 / /-0.69 -4.28 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -84.12 /-11.57 /-72.55 / /-18.95 -7.01 /-0.96 13 [bos] `` what are my chances for taking joe's place '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -79.77 /-11.76 /-68.01 / /-14.42 -6.14 /-0.90 14 [bos] `` what are my chances for taking joe's place '' ? . [eos] tgt4: mod/noi/dif/loss/nce/logp -72.74 /-12.20 /-60.54 / /-6.94 -5.60 /-0.94 14 [bos] `` what are my chances , taking joe's place '' ? ? [eos] tgt5: mod/noi/dif/loss/nce/logp -175.39/-12.46 /-162.93/ /-109.33 -17.54/-1.25 11 [bos] `` what are my chances for taking joe's place [eos] cls0 - sp0 : -8.80 -1.76 6 0.20 [bos] : ! ! ! [eos] cls0 - sp1 : -8.89 -1.78 6 0.00 [bos] : ! ! ! [eos] cls0 - sp2 : -8.98 -1.80 6 0.00 [bos] : ? ! ! [eos] cls0 - sp3 : -9.07 -1.81 6 0.20 [bos] : ! ! ! [eos] cls0 - sp4 : -9.13 -1.83 6 0.00 [bos] '' ) ! ! [eos] cls1 - sp0 : -8.94 -1.79 6 0.40 [bos] : ! ! ! [eos] cls1 - sp1 : -9.17 -1.83 6 0.40 [bos] '' ) ! later [eos] cls1 - sp2 : -9.37 -1.87 6 0.40 [bos] : ! ! ! [eos] cls1 - sp3 : -9.56 -1.91 6 0.40 [bos] '' ! ! ! [eos] cls1 - sp4 : -9.67 -1.93 6 0.40 [bos] : ! ! later [eos] cls2 - sp0 : -9.05 -1.81 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -9.27 -1.85 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -9.40 -1.88 6 0.60 [bos] : ! ! ! [eos] cls2 - sp3 : -9.45 -1.89 6 0.60 [bos] : ! ! ! [eos] cls2 - sp4 : -9.57 -1.91 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -7.20 -1.44 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -8.08 -1.62 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.31 -1.66 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -8.45 -1.69 6 1.00 [bos] : ! ! ! [eos] cls3 - sp4 : -8.45 -1.69 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-315 src: none none 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -61.16 /-1.35 /-59.81 /0.69/-0.69 -4.70 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -61.16 /-1.35 /-59.81 / /-0.69 -4.70 /-0.10 14 [bos] `` what are my chances for taking joe's place '' ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -89.38 /-11.57 /-77.80 / /-18.69 -7.45 /-0.96 13 [bos] `` what are my chances for taking joe's place '' ? [eos] tgt3: mod/noi/dif/loss/nce/logp -104.86/-11.76 /-93.10 / /-33.99 -8.07 /-0.90 14 [bos] `` what are my chances for taking joe's place '' ? . [eos] tgt4: mod/noi/dif/loss/nce/logp -78.62 /-12.20 /-66.42 / /-7.31 -6.05 /-0.94 14 [bos] `` what are my chances , taking joe's place '' ? ? [eos] tgt5: mod/noi/dif/loss/nce/logp -180.09/-12.46 /-167.63/ /-108.52 -18.01/-1.25 11 [bos] `` what are my chances for taking joe's place [eos] cls0 - sp0 : -8.80 -1.76 6 0.20 [bos] : ! ! ! [eos] cls0 - sp1 : -8.89 -1.78 6 0.00 [bos] : ! ! ! [eos] cls0 - sp2 : -8.98 -1.80 6 0.00 [bos] : ? ! ! [eos] cls0 - sp3 : -9.07 -1.81 6 0.20 [bos] : ! ! ! [eos] cls0 - sp4 : -9.13 -1.83 6 0.00 [bos] '' ) ! ! [eos] cls1 - sp0 : -8.94 -1.79 6 0.40 [bos] : ! ! ! [eos] cls1 - sp1 : -9.17 -1.83 6 0.40 [bos] '' ) ! later [eos] cls1 - sp2 : -9.37 -1.87 6 0.40 [bos] : ! ! ! [eos] cls1 - sp3 : -9.56 -1.91 6 0.40 [bos] '' ! ! ! [eos] cls1 - sp4 : -9.67 -1.93 6 0.40 [bos] : ! ! later [eos] cls2 - sp0 : -9.05 -1.81 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -9.27 -1.85 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -9.40 -1.88 6 0.60 [bos] : ! ! ! [eos] cls2 - sp3 : -9.45 -1.89 6 0.60 [bos] : ! ! ! [eos] cls2 - sp4 : -9.57 -1.91 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -7.20 -1.44 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -8.08 -1.62 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.31 -1.66 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -8.45 -1.69 6 1.00 [bos] : ! ! ! [eos] cls3 - sp4 : -8.45 -1.69 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-316 src: none none 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt0: mod/noi/dif/loss/nce/logp -65.60 /-2.47 /-63.13 /0.69/-0.69 -3.12 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt1: mod/noi/dif/loss/nce/logp -65.60 /-2.47 /-63.13 / /-0.69 -3.12 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt2: mod/noi/dif/loss/nce/logp -106.32/-13.35 /-92.96 / /-30.53 -5.32 /-0.67 21 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time [eos] tgt3: mod/noi/dif/loss/nce/logp -252.58/-12.42 /-240.16/ /-177.72 -28.06/-1.38 10 [bos] the [unk] night was made for romance . [eos] tgt4: mod/noi/dif/loss/nce/logp -223.45/-12.58 /-210.87/ /-148.43 -55.86/-3.15 5 [bos] the [unk] night [eos] tgt5: mod/noi/dif/loss/nce/logp -224.87/-12.37 /-212.50/ /-150.06 -37.48/-2.06 7 [bos] the [unk] night was made [eos] cls0 - sp0 : -27.68 -1.32 22 0.00 [bos] : [unk] first was made for cleaning , and he had been first at property [unk] for some by . [eos] cls0 - sp1 : -27.78 -1.32 22 0.00 [bos] : [unk] first was made for telephone , and he had been first at property [unk] for some by . [eos] cls0 - sp2 : -27.87 -1.33 22 0.00 [bos] : [unk] first was made for cleaning , and he had her first at property [unk] for some by . [eos] cls0 - sp3 : -27.93 -1.33 22 0.00 [bos] : [unk] first was made for telephone , and he had her first at property [unk] for some by . [eos] cls0 - sp4 : -27.95 -1.33 22 0.00 [bos] : [unk] first was made for cleaning , and he had been first at property [unk] for an by . [eos] cls1 - sp0 : -33.92 -1.62 22 0.29 [bos] : [unk] first was made for telephone , and he had her couldn't at ! [unk] for some by . [eos] cls1 - sp1 : -34.07 -1.62 22 0.29 [bos] : [unk] first was made for telephone , and he had been couldn't at ! [unk] for some by . [eos] cls1 - sp2 : -34.11 -1.62 22 0.29 [bos] : [unk] first was made for telephone , and he had her couldn't at ! [unk] for an by . [eos] cls1 - sp3 : -34.26 -1.63 22 0.29 [bos] : [unk] first was made for telephone , and he had been couldn't at ! [unk] for an by . [eos] cls1 - sp4 : -34.28 -1.63 22 0.29 [bos] : [unk] first was made for telephone , and he had were couldn't at ! [unk] for some by . [eos] cls2 - sp0 : -34.46 -1.64 22 0.71 [bos] : [unk] first was made for telephone , and he ! were almost at ! [unk] for -- by . [eos] cls2 - sp1 : -34.52 -1.64 22 0.71 [bos] : [unk] first was made for telephone , and he ! were first at ! [unk] for -- by . [eos] cls2 - sp2 : -34.61 -1.65 22 0.71 [bos] : [unk] first was made for telephone , and he ! were almost at ! [unk] for some by . [eos] cls2 - sp3 : -34.68 -1.65 22 0.71 [bos] : [unk] first was made for telephone , and he ! were first at ! [unk] for some by . [eos] cls2 - sp4 : -36.17 -1.72 22 0.67 [bos] : [unk] first was made for telephone , and he ! were almost at ! [unk] for -- by . [eos] cls3 - sp0 : -29.15 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at ! [unk] for some by . [eos] cls3 - sp1 : -29.23 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at her [unk] for -- by . [eos] cls3 - sp2 : -29.25 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at property [unk] for some by . [eos] cls3 - sp3 : -29.25 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at her [unk] for some by . [eos] cls3 - sp4 : -29.25 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at her [unk] for some which . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-317 src: none none 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt0: mod/noi/dif/loss/nce/logp -65.23 /-2.47 /-62.76 /0.69/-0.69 -3.11 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt1: mod/noi/dif/loss/nce/logp -65.23 /-2.47 /-62.76 / /-0.69 -3.11 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt2: mod/noi/dif/loss/nce/logp -109.98/-13.35 /-96.62 / /-34.55 -5.50 /-0.67 21 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time [eos] tgt3: mod/noi/dif/loss/nce/logp -245.59/-12.42 /-233.17/ /-171.10 -27.29/-1.38 10 [bos] the [unk] night was made for romance . [eos] tgt4: mod/noi/dif/loss/nce/logp -222.51/-12.58 /-209.93/ /-147.86 -55.63/-3.15 5 [bos] the [unk] night [eos] tgt5: mod/noi/dif/loss/nce/logp -225.55/-12.37 /-213.18/ /-151.11 -37.59/-2.06 7 [bos] the [unk] night was made [eos] cls0 - sp0 : -27.68 -1.32 22 0.00 [bos] : [unk] first was made for cleaning , and he had been first at property [unk] for some by . [eos] cls0 - sp1 : -27.78 -1.32 22 0.00 [bos] : [unk] first was made for telephone , and he had been first at property [unk] for some by . [eos] cls0 - sp2 : -27.87 -1.33 22 0.00 [bos] : [unk] first was made for cleaning , and he had her first at property [unk] for some by . [eos] cls0 - sp3 : -27.93 -1.33 22 0.00 [bos] : [unk] first was made for telephone , and he had her first at property [unk] for some by . [eos] cls0 - sp4 : -27.95 -1.33 22 0.00 [bos] : [unk] first was made for cleaning , and he had been first at property [unk] for an by . [eos] cls1 - sp0 : -33.92 -1.62 22 0.29 [bos] : [unk] first was made for telephone , and he had her couldn't at ! [unk] for some by . [eos] cls1 - sp1 : -34.07 -1.62 22 0.29 [bos] : [unk] first was made for telephone , and he had been couldn't at ! [unk] for some by . [eos] cls1 - sp2 : -34.11 -1.62 22 0.29 [bos] : [unk] first was made for telephone , and he had her couldn't at ! [unk] for an by . [eos] cls1 - sp3 : -34.26 -1.63 22 0.29 [bos] : [unk] first was made for telephone , and he had been couldn't at ! [unk] for an by . [eos] cls1 - sp4 : -34.28 -1.63 22 0.29 [bos] : [unk] first was made for telephone , and he had were couldn't at ! [unk] for some by . [eos] cls2 - sp0 : -34.46 -1.64 22 0.71 [bos] : [unk] first was made for telephone , and he ! were almost at ! [unk] for -- by . [eos] cls2 - sp1 : -34.52 -1.64 22 0.71 [bos] : [unk] first was made for telephone , and he ! were first at ! [unk] for -- by . [eos] cls2 - sp2 : -34.61 -1.65 22 0.71 [bos] : [unk] first was made for telephone , and he ! were almost at ! [unk] for some by . [eos] cls2 - sp3 : -34.68 -1.65 22 0.71 [bos] : [unk] first was made for telephone , and he ! were first at ! [unk] for some by . [eos] cls2 - sp4 : -36.17 -1.72 22 0.67 [bos] : [unk] first was made for telephone , and he ! were almost at ! [unk] for -- by . [eos] cls3 - sp0 : -29.15 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at ! [unk] for some by . [eos] cls3 - sp1 : -29.23 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at her [unk] for -- by . [eos] cls3 - sp2 : -29.25 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at property [unk] for some by . [eos] cls3 - sp3 : -29.25 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at her [unk] for some by . [eos] cls3 - sp4 : -29.25 -1.39 22 1.00 [bos] she [unk] first was made for housing , and he ! were first at her [unk] for some which . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-318 src: none none 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt0: mod/noi/dif/loss/nce/logp -65.39 /-2.47 /-62.92 /0.69/-0.69 -3.11 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt1: mod/noi/dif/loss/nce/logp -65.39 /-2.47 /-62.92 / /-0.69 -3.11 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt2: mod/noi/dif/loss/nce/logp -104.26/-13.35 /-90.91 / /-28.68 -5.21 /-0.67 21 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time [eos] tgt3: mod/noi/dif/loss/nce/logp -257.84/-12.42 /-245.42/ /-183.19 -28.65/-1.38 10 [bos] the [unk] night was made for romance . [eos] tgt4: mod/noi/dif/loss/nce/logp -199.56/-12.58 /-186.97/ /-124.75 -49.89/-3.15 5 [bos] the [unk] night [eos] tgt5: mod/noi/dif/loss/nce/logp -218.22/-12.37 /-205.84/ /-143.61 -36.37/-2.06 7 [bos] the [unk] night was made [eos] cls0 - sp0 : -32.29 -1.54 22 0.00 [bos] : [unk] first was made was cleaning , and he had its united at it [unk] for -- there . [eos] cls0 - sp1 : -32.30 -1.54 22 0.00 [bos] : [unk] couldn't was made for cleaning , and he had its united at it [unk] for -- there . [eos] cls0 - sp2 : -32.37 -1.54 22 0.00 [bos] : [unk] couldn't was made was cleaning , and he had its united at it [unk] for -- there . [eos] cls0 - sp3 : -32.39 -1.54 22 0.00 [bos] : [unk] first was made was cleaning , and he had been united at it [unk] for -- there . [eos] cls0 - sp4 : -32.40 -1.54 22 0.00 [bos] : [unk] first was made for cleaning , and he had been united at it [unk] for -- there . [eos] cls1 - sp0 : -39.48 -1.88 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at ! [unk] for -- on . [eos] cls1 - sp1 : -41.00 -1.95 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at it [unk] for -- on . [eos] cls1 - sp2 : -41.02 -1.95 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at property [unk] for -- on . [eos] cls1 - sp3 : -41.09 -1.96 22 0.33 [bos] she [unk] couldn't was made was telephone , and he had its ! at ! [unk] for -- on . [eos] cls1 - sp4 : -41.12 -1.96 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at her [unk] for -- on . [eos] cls2 - sp0 : -37.00 -1.76 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- on . [eos] cls2 - sp1 : -37.32 -1.78 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- space . [eos] cls2 - sp2 : -37.35 -1.78 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- an . [eos] cls2 - sp3 : -37.47 -1.78 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- all . [eos] cls2 - sp4 : -37.57 -1.79 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- there . [eos] cls3 - sp0 : -30.50 -1.45 22 1.00 [bos] she [unk] almost was made for telephone , and he had been personal at her [unk] for -- on . [eos] cls3 - sp1 : -30.55 -1.45 22 1.00 [bos] she [unk] personal was made for telephone , and he had been personal at her [unk] for -- on . [eos] cls3 - sp2 : -30.63 -1.46 22 1.00 [bos] she [unk] first was made for telephone , and he had been personal at her [unk] for -- on . [eos] cls3 - sp3 : -30.72 -1.46 22 1.00 [bos] she [unk] almost was made for telephone , and he had were personal at her [unk] for -- on . [eos] cls3 - sp4 : -30.76 -1.46 22 1.00 [bos] she [unk] personal was made for telephone , and he had were personal at her [unk] for -- on . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-319 src: none none 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt0: mod/noi/dif/loss/nce/logp -63.20 /-2.47 /-60.73 /0.69/-0.69 -3.01 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt1: mod/noi/dif/loss/nce/logp -63.20 /-2.47 /-60.73 / /-0.69 -3.01 /-0.12 22 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time . [eos] tgt2: mod/noi/dif/loss/nce/logp -106.36/-13.35 /-93.01 / /-32.97 -5.32 /-0.67 21 [bos] the [unk] night was made for romance , and he had been looking at her [unk] for some time [eos] tgt3: mod/noi/dif/loss/nce/logp -248.19/-12.42 /-235.77/ /-175.74 -27.58/-1.38 10 [bos] the [unk] night was made for romance . [eos] tgt4: mod/noi/dif/loss/nce/logp -196.79/-12.58 /-184.21/ /-124.18 -49.20/-3.15 5 [bos] the [unk] night [eos] tgt5: mod/noi/dif/loss/nce/logp -218.14/-12.37 /-205.77/ /-145.74 -36.36/-2.06 7 [bos] the [unk] night was made [eos] cls0 - sp0 : -32.29 -1.54 22 0.00 [bos] : [unk] first was made was cleaning , and he had its united at it [unk] for -- there . [eos] cls0 - sp1 : -32.30 -1.54 22 0.00 [bos] : [unk] couldn't was made for cleaning , and he had its united at it [unk] for -- there . [eos] cls0 - sp2 : -32.37 -1.54 22 0.00 [bos] : [unk] couldn't was made was cleaning , and he had its united at it [unk] for -- there . [eos] cls0 - sp3 : -32.39 -1.54 22 0.00 [bos] : [unk] first was made was cleaning , and he had been united at it [unk] for -- there . [eos] cls0 - sp4 : -32.40 -1.54 22 0.00 [bos] : [unk] first was made for cleaning , and he had been united at it [unk] for -- there . [eos] cls1 - sp0 : -39.48 -1.88 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at ! [unk] for -- on . [eos] cls1 - sp1 : -41.00 -1.95 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at it [unk] for -- on . [eos] cls1 - sp2 : -41.02 -1.95 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at property [unk] for -- on . [eos] cls1 - sp3 : -41.09 -1.96 22 0.33 [bos] she [unk] couldn't was made was telephone , and he had its ! at ! [unk] for -- on . [eos] cls1 - sp4 : -41.12 -1.96 22 0.29 [bos] she [unk] couldn't was made was telephone , and he had its ! at her [unk] for -- on . [eos] cls2 - sp0 : -37.00 -1.76 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- on . [eos] cls2 - sp1 : -37.32 -1.78 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- space . [eos] cls2 - sp2 : -37.35 -1.78 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- an . [eos] cls2 - sp3 : -37.47 -1.78 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- all . [eos] cls2 - sp4 : -37.57 -1.79 22 0.71 [bos] she [unk] couldn't was made for telephone , and he had its ! at her [unk] for -- there . [eos] cls3 - sp0 : -30.50 -1.45 22 1.00 [bos] she [unk] almost was made for telephone , and he had been personal at her [unk] for -- on . [eos] cls3 - sp1 : -30.55 -1.45 22 1.00 [bos] she [unk] personal was made for telephone , and he had been personal at her [unk] for -- on . [eos] cls3 - sp2 : -30.63 -1.46 22 1.00 [bos] she [unk] first was made for telephone , and he had been personal at her [unk] for -- on . [eos] cls3 - sp3 : -30.72 -1.46 22 1.00 [bos] she [unk] almost was made for telephone , and he had were personal at her [unk] for -- on . [eos] cls3 - sp4 : -30.76 -1.46 22 1.00 [bos] she [unk] personal was made for telephone , and he had were personal at her [unk] for -- on . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-320 src: none none 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -75.64 /-2.34 /-73.30 /0.69/-0.69 -3.60 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -75.64 /-2.34 /-73.30 / /-0.69 -3.60 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -116.47/-13.28 /-103.19/ /-30.59 -5.82 /-0.66 21 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' [eos] tgt3: mod/noi/dif/loss/nce/logp -99.74 /-13.02 /-86.72 / /-14.12 -4.75 /-0.62 22 [bos] if you are thinking of giving him a berth , , sure to make it a wide one '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -99.97 /-13.41 /-86.56 / /-13.96 -4.76 /-0.64 22 [bos] if you are thinking of giving him the berth , be sure to make it a wide one '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -221.66/-13.64 /-208.02/ /-135.41 -11.67/-0.72 20 [bos] if you are thinking of giving him a berth , be sure to make it a wide one [eos] cls0 - sp0 : -33.61 -1.60 22 0.00 [bos] it it are later of couldn't but a joined , be streets to any it a `` one '' . [eos] cls0 - sp1 : -33.65 -1.60 22 0.00 [bos] it it are later of i but a joined , be streets to any it a `` one '' . [eos] cls0 - sp2 : -33.67 -1.60 22 0.00 [bos] it it are later of couldn't him a joined , be streets to any it a `` one '' . [eos] cls0 - sp3 : -33.71 -1.61 22 0.00 [bos] it it are later of couldn't but a joined , be deck to any it a `` one '' . [eos] cls0 - sp4 : -33.76 -1.61 22 0.00 [bos] it it are later of couldn't but a joined , be streets to no it a `` one '' . [eos] cls1 - sp0 : -35.94 -1.71 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a `` one '' . [eos] cls1 - sp1 : -37.30 -1.78 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a `` ; '' . [eos] cls1 - sp2 : -37.39 -1.78 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a '' one '' . [eos] cls1 - sp3 : -39.04 -1.86 22 0.33 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a `` one '' . [eos] cls1 - sp4 : -39.89 -1.90 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! it a `` one '' . [eos] cls2 - sp0 : -38.89 -1.85 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to later it a `` one '' . [eos] cls2 - sp1 : -38.96 -1.86 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to no it a `` one '' . [eos] cls2 - sp2 : -38.97 -1.86 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to later it a `` one '' . [eos] cls2 - sp3 : -39.04 -1.86 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to no it a `` one '' . [eos] cls2 - sp4 : -39.31 -1.87 22 0.71 [bos] ! ! ! ! of ! but a telephone , be did to later it a `` one '' . [eos] cls3 - sp0 : -31.39 -1.49 22 1.00 [bos] ! ! ! ! of later but a telephone , be did to later it a `` one '' . [eos] cls3 - sp1 : -31.50 -1.50 22 1.00 [bos] ! ! ! ! of later but a telephone , be streets to later it a `` one '' . [eos] cls3 - sp2 : -31.57 -1.50 22 1.00 [bos] ! ! ! ! of later but a telephone , be did to no it a `` one '' . [eos] cls3 - sp3 : -31.67 -1.51 22 1.00 [bos] ! ! ! ! of later but a telephone , be streets to no it a `` one '' . [eos] cls3 - sp4 : -31.72 -1.51 22 1.00 [bos] ! ! ! ! of later but a corner , be did to later it a `` one '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-321 src: none none 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -75.66 /-2.34 /-73.33 /0.69/-0.69 -3.60 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -75.66 /-2.34 /-73.33 / /-0.69 -3.60 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -119.70/-13.28 /-106.42/ /-33.79 -5.99 /-0.66 21 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' [eos] tgt3: mod/noi/dif/loss/nce/logp -99.55 /-13.02 /-86.53 / /-13.89 -4.74 /-0.62 22 [bos] if you are thinking of giving him a berth , , sure to make it a wide one '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -99.52 /-13.41 /-86.11 / /-13.48 -4.74 /-0.64 22 [bos] if you are thinking of giving him the berth , be sure to make it a wide one '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -197.31/-13.64 /-183.67/ /-111.04 -10.38/-0.72 20 [bos] if you are thinking of giving him a berth , be sure to make it a wide one [eos] cls0 - sp0 : -33.61 -1.60 22 0.00 [bos] it it are later of couldn't but a joined , be streets to any it a `` one '' . [eos] cls0 - sp1 : -33.65 -1.60 22 0.00 [bos] it it are later of i but a joined , be streets to any it a `` one '' . [eos] cls0 - sp2 : -33.67 -1.60 22 0.00 [bos] it it are later of couldn't him a joined , be streets to any it a `` one '' . [eos] cls0 - sp3 : -33.71 -1.61 22 0.00 [bos] it it are later of couldn't but a joined , be deck to any it a `` one '' . [eos] cls0 - sp4 : -33.76 -1.61 22 0.00 [bos] it it are later of couldn't but a joined , be streets to no it a `` one '' . [eos] cls1 - sp0 : -35.94 -1.71 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a `` one '' . [eos] cls1 - sp1 : -37.30 -1.78 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a `` ; '' . [eos] cls1 - sp2 : -37.39 -1.78 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a '' one '' . [eos] cls1 - sp3 : -39.04 -1.86 22 0.33 [bos] ! ! ! ! of ! but a pain , be fractions to ! ! a `` one '' . [eos] cls1 - sp4 : -39.89 -1.90 22 0.29 [bos] ! ! ! ! of ! but a pain , be fractions to ! it a `` one '' . [eos] cls2 - sp0 : -38.89 -1.85 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to later it a `` one '' . [eos] cls2 - sp1 : -38.96 -1.86 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to no it a `` one '' . [eos] cls2 - sp2 : -38.97 -1.86 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to later it a `` one '' . [eos] cls2 - sp3 : -39.04 -1.86 22 0.71 [bos] ! ! ! ! of later but a telephone , be did to no it a `` one '' . [eos] cls2 - sp4 : -39.31 -1.87 22 0.71 [bos] ! ! ! ! of ! but a telephone , be did to later it a `` one '' . [eos] cls3 - sp0 : -31.39 -1.49 22 1.00 [bos] ! ! ! ! of later but a telephone , be did to later it a `` one '' . [eos] cls3 - sp1 : -31.50 -1.50 22 1.00 [bos] ! ! ! ! of later but a telephone , be streets to later it a `` one '' . [eos] cls3 - sp2 : -31.57 -1.50 22 1.00 [bos] ! ! ! ! of later but a telephone , be did to no it a `` one '' . [eos] cls3 - sp3 : -31.67 -1.51 22 1.00 [bos] ! ! ! ! of later but a telephone , be streets to no it a `` one '' . [eos] cls3 - sp4 : -31.72 -1.51 22 1.00 [bos] ! ! ! ! of later but a corner , be did to later it a `` one '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-322 src: none none 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -73.48 /-2.34 /-71.14 /0.69/-0.69 -3.50 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -73.48 /-2.34 /-71.14 / /-0.69 -3.50 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.17/-13.28 /-99.89 / /-29.44 -5.66 /-0.66 21 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' [eos] tgt3: mod/noi/dif/loss/nce/logp -97.33 /-13.02 /-84.31 / /-13.86 -4.63 /-0.62 22 [bos] if you are thinking of giving him a berth , , sure to make it a wide one '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -97.86 /-13.41 /-84.45 / /-14.00 -4.66 /-0.64 22 [bos] if you are thinking of giving him the berth , be sure to make it a wide one '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -208.93/-13.64 /-195.29/ /-124.84 -11.00/-0.72 20 [bos] if you are thinking of giving him a berth , be sure to make it a wide one [eos] cls0 - sp0 : -31.67 -1.51 22 0.24 [bos] ! ! ! ! of ! `` a editor , be it to ! it a ! one '' . [eos] cls0 - sp1 : -32.11 -1.53 22 0.00 [bos] we it are later of i `` a streets , be it to this it a dr. one '' . [eos] cls0 - sp2 : -32.15 -1.53 22 0.00 [bos] we property are later of i `` a streets , be it to this it a dr. one '' . [eos] cls0 - sp3 : -32.22 -1.53 22 0.00 [bos] we it are later of later `` a streets , be it to this it a dr. one '' . [eos] cls0 - sp4 : -32.23 -1.53 22 0.00 [bos] we it are later of i `` a streets , be it to this it a sake one '' . [eos] cls1 - sp0 : -29.67 -1.75 18 0.47 [bos] ! ! ! ! of ! `` a patience , be it to ! ! a [eos] cls1 - sp1 : -29.79 -1.75 18 0.47 [bos] ! ! ! ! of ! `` a couldn't , be it to ! ! a [eos] cls1 - sp2 : -29.87 -1.76 18 0.47 [bos] ! ! ! ! of ! `` a pain , be it to ! ! a [eos] cls1 - sp3 : -29.89 -1.76 18 0.47 [bos] ! ! ! ! of ! `` a streets , be it to ! ! a [eos] cls1 - sp4 : -29.92 -1.76 18 0.47 [bos] ! ! ! ! of ! `` a cleaning , be it to ! ! a [eos] cls2 - sp0 : -31.27 -1.84 18 0.53 [bos] ! ! ! ! of ! `` a patience , be it to ! ! a [eos] cls2 - sp1 : -31.29 -1.84 18 0.53 [bos] ! ! ! ! of ! `` a cleaning , be it to ! ! a [eos] cls2 - sp2 : -31.32 -1.84 18 0.53 [bos] ! ! ! ! of ! `` a pain , be it to ! ! a [eos] cls2 - sp3 : -31.38 -1.85 18 0.53 [bos] ! ! ! ! of ! `` a streets , be it to ! ! a [eos] cls2 - sp4 : -31.47 -1.85 18 0.53 [bos] ! ! ! ! of ! `` a editor , be it to ! ! a [eos] cls3 - sp0 : -30.24 -1.44 22 1.00 [bos] ! ! ! ! of later `` a telephone , be it to this it a streets one '' . [eos] cls3 - sp1 : -30.33 -1.44 22 1.00 [bos] ! ! ! ! of later `` a telephone , be it to this it a property one '' . [eos] cls3 - sp2 : -30.43 -1.45 22 1.00 [bos] ! ! ! ! of later `` a telephone , be it to this it a ! one '' . [eos] cls3 - sp3 : -30.63 -1.46 22 1.00 [bos] ! ! ! ! of ! `` a telephone , be it to this it a ! one '' . [eos] cls3 - sp4 : -30.67 -1.46 22 1.00 [bos] ! ! ! ! of later `` a mississippi , be it to this it a ! one '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-323 src: none none 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt0: mod/noi/dif/loss/nce/logp -75.15 /-2.34 /-72.81 /0.69/-0.69 -3.58 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt1: mod/noi/dif/loss/nce/logp -75.15 /-2.34 /-72.81 / /-0.69 -3.58 /-0.11 22 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' . [eos] tgt2: mod/noi/dif/loss/nce/logp -117.71/-13.28 /-104.43/ /-32.31 -5.89 /-0.66 21 [bos] if you are thinking of giving him a berth , be sure to make it a wide one '' [eos] tgt3: mod/noi/dif/loss/nce/logp -98.80 /-13.02 /-85.77 / /-13.65 -4.70 /-0.62 22 [bos] if you are thinking of giving him a berth , , sure to make it a wide one '' . [eos] tgt4: mod/noi/dif/loss/nce/logp -98.84 /-13.41 /-85.43 / /-13.31 -4.71 /-0.64 22 [bos] if you are thinking of giving him the berth , be sure to make it a wide one '' . [eos] tgt5: mod/noi/dif/loss/nce/logp -189.52/-13.64 /-175.88/ /-103.76 -9.97 /-0.72 20 [bos] if you are thinking of giving him a berth , be sure to make it a wide one [eos] cls0 - sp0 : -31.67 -1.51 22 0.24 [bos] ! ! ! ! of ! `` a editor , be it to ! it a ! one '' . [eos] cls0 - sp1 : -32.11 -1.53 22 0.00 [bos] we it are later of i `` a streets , be it to this it a dr. one '' . [eos] cls0 - sp2 : -32.15 -1.53 22 0.00 [bos] we property are later of i `` a streets , be it to this it a dr. one '' . [eos] cls0 - sp3 : -32.22 -1.53 22 0.00 [bos] we it are later of later `` a streets , be it to this it a dr. one '' . [eos] cls0 - sp4 : -32.23 -1.53 22 0.00 [bos] we it are later of i `` a streets , be it to this it a sake one '' . [eos] cls1 - sp0 : -29.67 -1.75 18 0.47 [bos] ! ! ! ! of ! `` a patience , be it to ! ! a [eos] cls1 - sp1 : -29.79 -1.75 18 0.47 [bos] ! ! ! ! of ! `` a couldn't , be it to ! ! a [eos] cls1 - sp2 : -29.87 -1.76 18 0.47 [bos] ! ! ! ! of ! `` a pain , be it to ! ! a [eos] cls1 - sp3 : -29.89 -1.76 18 0.47 [bos] ! ! ! ! of ! `` a streets , be it to ! ! a [eos] cls1 - sp4 : -29.92 -1.76 18 0.47 [bos] ! ! ! ! of ! `` a cleaning , be it to ! ! a [eos] cls2 - sp0 : -31.27 -1.84 18 0.53 [bos] ! ! ! ! of ! `` a patience , be it to ! ! a [eos] cls2 - sp1 : -31.29 -1.84 18 0.53 [bos] ! ! ! ! of ! `` a cleaning , be it to ! ! a [eos] cls2 - sp2 : -31.32 -1.84 18 0.53 [bos] ! ! ! ! of ! `` a pain , be it to ! ! a [eos] cls2 - sp3 : -31.38 -1.85 18 0.53 [bos] ! ! ! ! of ! `` a streets , be it to ! ! a [eos] cls2 - sp4 : -31.47 -1.85 18 0.53 [bos] ! ! ! ! of ! `` a editor , be it to ! ! a [eos] cls3 - sp0 : -30.24 -1.44 22 1.00 [bos] ! ! ! ! of later `` a telephone , be it to this it a streets one '' . [eos] cls3 - sp1 : -30.33 -1.44 22 1.00 [bos] ! ! ! ! of later `` a telephone , be it to this it a property one '' . [eos] cls3 - sp2 : -30.43 -1.45 22 1.00 [bos] ! ! ! ! of later `` a telephone , be it to this it a ! one '' . [eos] cls3 - sp3 : -30.63 -1.46 22 1.00 [bos] ! ! ! ! of ! `` a telephone , be it to this it a ! one '' . [eos] cls3 - sp4 : -30.67 -1.46 22 1.00 [bos] ! ! ! ! of later `` a mississippi , be it to this it a ! one '' . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-324 src: none none 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt0: mod/noi/dif/loss/nce/logp -78.81 /-1.02 /-77.79 /0.69/-0.69 -6.57 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt1: mod/noi/dif/loss/nce/logp -78.81 /-1.02 /-77.79 / /-0.69 -6.57 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt2: mod/noi/dif/loss/nce/logp -118.59/-12.15 /-106.44/ /-29.35 -9.12 /-0.93 14 [bos] ambiguity arises when the pronoun it carries a twofold reference . . [eos] tgt3: mod/noi/dif/loss/nce/logp -101.94/-12.13 /-89.82 / /-12.72 -8.50 /-1.01 13 [bos] ambiguity arises when the pronoun it carries the twofold reference . [eos] tgt4: mod/noi/dif/loss/nce/logp -107.41/-12.02 /-95.39 / /-18.29 -9.76 /-1.09 12 [bos] ambiguity arises when the pronoun it carries a twofold reference [eos] tgt5: mod/noi/dif/loss/nce/logp -95.72 /-11.52 /-84.21 / /-7.11 -7.98 /-0.96 13 [bos] ambiguity arises his the pronoun it carries a twofold reference . [eos] cls0 - sp0 : -22.00 -2.00 12 0.18 [bos] ! ! ! the ! ! ! a ! ! [eos] cls0 - sp1 : -22.16 -2.01 12 0.18 [bos] ! ! ! the ! ! ! a ! ! [eos] cls0 - sp2 : -22.42 -2.04 12 0.00 [bos] she any when the streets it streets a later . [eos] cls0 - sp3 : -22.43 -2.04 12 0.00 [bos] she no when the streets it streets a later . [eos] cls0 - sp4 : -22.61 -2.06 12 0.00 [bos] i no when the streets it streets a later . [eos] cls1 - sp0 : -18.03 -2.58 8 0.29 [bos] ! ! ! the ! ! [eos] cls1 - sp1 : -18.92 -2.70 8 0.43 [bos] ! ! ! the ! ! [eos] cls1 - sp2 : -21.61 -1.96 12 0.27 [bos] ! ! ! the ! ! ! a ! ! [eos] cls1 - sp3 : -21.65 -1.97 12 0.45 [bos] ! ! ! the ! ! ! a ! ! [eos] cls1 - sp4 : -21.67 -1.97 12 0.36 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp0 : -21.32 -1.94 12 0.64 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp1 : -21.54 -1.96 12 0.55 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp2 : -21.81 -1.98 12 0.64 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp3 : -21.84 -1.99 12 0.55 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp4 : -21.88 -1.99 12 0.64 [bos] ! ! ! the ! ! ! a ! ! [eos] cls3 - sp0 : -18.63 -1.55 13 1.00 [bos] ! ! ! the ! ! ! a ! ! ! [eos] cls3 - sp1 : -19.17 -1.74 12 0.91 [bos] ! ! ! the ! ! ! a ! ! [eos] cls3 - sp2 : -19.32 -1.61 13 0.92 [bos] ! ! ! the ! ! ! a ! ! ! [eos] cls3 - sp3 : -19.53 -1.63 13 0.92 [bos] ! ! ! the ! ! ! a ! ! ! [eos] cls3 - sp4 : -19.76 -1.80 12 0.82 [bos] ! ! ! the ! ! ! a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-325 src: none none 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt0: mod/noi/dif/loss/nce/logp -92.07 /-1.02 /-91.05 /0.69/-0.69 -7.67 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt1: mod/noi/dif/loss/nce/logp -92.07 /-1.02 /-91.05 / /-0.69 -7.67 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt2: mod/noi/dif/loss/nce/logp -131.95/-12.15 /-119.79/ /-29.44 -10.15/-0.93 14 [bos] ambiguity arises when the pronoun it carries a twofold reference . . [eos] tgt3: mod/noi/dif/loss/nce/logp -114.34/-12.13 /-102.21/ /-11.86 -9.53 /-1.01 13 [bos] ambiguity arises when the pronoun it carries the twofold reference . [eos] tgt4: mod/noi/dif/loss/nce/logp -122.92/-12.02 /-110.90/ /-20.54 -11.17/-1.09 12 [bos] ambiguity arises when the pronoun it carries a twofold reference [eos] tgt5: mod/noi/dif/loss/nce/logp -108.49/-11.52 /-96.98 / /-6.62 -9.04 /-0.96 13 [bos] ambiguity arises his the pronoun it carries a twofold reference . [eos] cls0 - sp0 : -22.00 -2.00 12 0.18 [bos] ! ! ! the ! ! ! a ! ! [eos] cls0 - sp1 : -22.16 -2.01 12 0.18 [bos] ! ! ! the ! ! ! a ! ! [eos] cls0 - sp2 : -22.42 -2.04 12 0.00 [bos] she any when the streets it streets a later . [eos] cls0 - sp3 : -22.43 -2.04 12 0.00 [bos] she no when the streets it streets a later . [eos] cls0 - sp4 : -22.61 -2.06 12 0.00 [bos] i no when the streets it streets a later . [eos] cls1 - sp0 : -18.03 -2.58 8 0.29 [bos] ! ! ! the ! ! [eos] cls1 - sp1 : -18.92 -2.70 8 0.43 [bos] ! ! ! the ! ! [eos] cls1 - sp2 : -21.61 -1.96 12 0.27 [bos] ! ! ! the ! ! ! a ! ! [eos] cls1 - sp3 : -21.65 -1.97 12 0.45 [bos] ! ! ! the ! ! ! a ! ! [eos] cls1 - sp4 : -21.67 -1.97 12 0.36 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp0 : -21.32 -1.94 12 0.64 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp1 : -21.54 -1.96 12 0.55 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp2 : -21.81 -1.98 12 0.64 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp3 : -21.84 -1.99 12 0.55 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp4 : -21.88 -1.99 12 0.64 [bos] ! ! ! the ! ! ! a ! ! [eos] cls3 - sp0 : -18.63 -1.55 13 1.00 [bos] ! ! ! the ! ! ! a ! ! ! [eos] cls3 - sp1 : -19.17 -1.74 12 0.91 [bos] ! ! ! the ! ! ! a ! ! [eos] cls3 - sp2 : -19.32 -1.61 13 0.92 [bos] ! ! ! the ! ! ! a ! ! ! [eos] cls3 - sp3 : -19.53 -1.63 13 0.92 [bos] ! ! ! the ! ! ! a ! ! ! [eos] cls3 - sp4 : -19.76 -1.80 12 0.82 [bos] ! ! ! the ! ! ! a ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-326 src: none none 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt0: mod/noi/dif/loss/nce/logp -78.11 /-1.02 /-77.09 /0.69/-0.69 -6.51 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt1: mod/noi/dif/loss/nce/logp -78.11 /-1.02 /-77.09 / /-0.69 -6.51 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt2: mod/noi/dif/loss/nce/logp -116.66/-12.15 /-104.51/ /-28.12 -8.97 /-0.93 14 [bos] ambiguity arises when the pronoun it carries a twofold reference . . [eos] tgt3: mod/noi/dif/loss/nce/logp -100.74/-12.13 /-88.61 / /-12.22 -8.39 /-1.01 13 [bos] ambiguity arises when the pronoun it carries the twofold reference . [eos] tgt4: mod/noi/dif/loss/nce/logp -105.43/-12.02 /-93.40 / /-17.01 -9.58 /-1.09 12 [bos] ambiguity arises when the pronoun it carries a twofold reference [eos] tgt5: mod/noi/dif/loss/nce/logp -95.86 /-11.52 /-84.34 / /-7.95 -7.99 /-0.96 13 [bos] ambiguity arises his the pronoun it carries a twofold reference . [eos] cls0 - sp0 : -25.85 -2.35 12 0.18 [bos] ! ! ! the ! ! ! a ! ! [eos] cls0 - sp1 : -26.20 -2.18 13 0.17 [bos] ! ! ! the ! ! ! a ! ! . [eos] cls0 - sp2 : -27.76 -2.31 13 0.00 [bos] i mean when the streets it mean a joined no . [eos] cls0 - sp3 : -27.79 -2.32 13 0.00 [bos] i mean when the streets it couldn't a joined no . [eos] cls0 - sp4 : -27.85 -2.32 13 0.00 [bos] she mean when the streets it mean a joined no . [eos] cls1 - sp0 : -12.44 -2.49 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -17.84 -2.55 8 0.29 [bos] ! ! ! the ! ! [eos] cls1 - sp2 : -18.33 -2.62 8 0.43 [bos] ! ! ! the ! ! [eos] cls1 - sp3 : -25.12 -2.28 12 0.36 [bos] ! ! ! the ! ! ! a ! ! [eos] cls1 - sp4 : -25.33 -2.30 12 0.27 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp0 : -12.85 -2.57 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -15.44 -2.21 8 0.71 [bos] ! ! ! the ! ! [eos] cls2 - sp2 : -15.87 -2.27 8 0.71 [bos] ! ! ! the ! ! [eos] cls2 - sp3 : -16.23 -2.32 8 0.57 [bos] ! ! ! the ! ! [eos] cls2 - sp4 : -16.99 -2.43 8 0.71 [bos] ! ! ! the ! ! [eos] cls3 - sp0 : -14.81 -2.12 8 0.86 [bos] ! ! ! the ! ! [eos] cls3 - sp1 : -15.12 -2.16 8 1.00 [bos] ! 7 ! the ! ! [eos] cls3 - sp2 : -15.90 -2.27 8 0.86 [bos] ! 7 ! the ! ! [eos] cls3 - sp3 : -18.16 -2.02 10 1.00 [bos] ! ! ! the ! ! ! ) [eos] cls3 - sp4 : -18.52 -2.06 10 0.89 [bos] ! ! ! the ! ! ! ) [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-327 src: none none 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt0: mod/noi/dif/loss/nce/logp -90.95 /-1.02 /-89.93 /0.69/-0.69 -7.58 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt1: mod/noi/dif/loss/nce/logp -90.95 /-1.02 /-89.93 / /-0.69 -7.58 /-0.09 13 [bos] ambiguity arises when the pronoun it carries a twofold reference . [eos] tgt2: mod/noi/dif/loss/nce/logp -130.77/-12.15 /-118.62/ /-29.38 -10.06/-0.93 14 [bos] ambiguity arises when the pronoun it carries a twofold reference . . [eos] tgt3: mod/noi/dif/loss/nce/logp -112.50/-12.13 /-100.38/ /-11.14 -9.38 /-1.01 13 [bos] ambiguity arises when the pronoun it carries the twofold reference . [eos] tgt4: mod/noi/dif/loss/nce/logp -121.66/-12.02 /-109.64/ /-20.40 -11.06/-1.09 12 [bos] ambiguity arises when the pronoun it carries a twofold reference [eos] tgt5: mod/noi/dif/loss/nce/logp -107.59/-11.52 /-96.07 / /-6.83 -8.97 /-0.96 13 [bos] ambiguity arises his the pronoun it carries a twofold reference . [eos] cls0 - sp0 : -25.85 -2.35 12 0.18 [bos] ! ! ! the ! ! ! a ! ! [eos] cls0 - sp1 : -26.20 -2.18 13 0.17 [bos] ! ! ! the ! ! ! a ! ! . [eos] cls0 - sp2 : -27.76 -2.31 13 0.00 [bos] i mean when the streets it mean a joined no . [eos] cls0 - sp3 : -27.79 -2.32 13 0.00 [bos] i mean when the streets it couldn't a joined no . [eos] cls0 - sp4 : -27.85 -2.32 13 0.00 [bos] she mean when the streets it mean a joined no . [eos] cls1 - sp0 : -12.44 -2.49 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -17.84 -2.55 8 0.29 [bos] ! ! ! the ! ! [eos] cls1 - sp2 : -18.33 -2.62 8 0.43 [bos] ! ! ! the ! ! [eos] cls1 - sp3 : -25.12 -2.28 12 0.36 [bos] ! ! ! the ! ! ! a ! ! [eos] cls1 - sp4 : -25.33 -2.30 12 0.27 [bos] ! ! ! the ! ! ! a ! ! [eos] cls2 - sp0 : -12.85 -2.57 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -15.44 -2.21 8 0.71 [bos] ! ! ! the ! ! [eos] cls2 - sp2 : -15.87 -2.27 8 0.71 [bos] ! ! ! the ! ! [eos] cls2 - sp3 : -16.23 -2.32 8 0.57 [bos] ! ! ! the ! ! [eos] cls2 - sp4 : -16.99 -2.43 8 0.71 [bos] ! ! ! the ! ! [eos] cls3 - sp0 : -14.81 -2.12 8 0.86 [bos] ! ! ! the ! ! [eos] cls3 - sp1 : -15.12 -2.16 8 1.00 [bos] ! 7 ! the ! ! [eos] cls3 - sp2 : -15.90 -2.27 8 0.86 [bos] ! 7 ! the ! ! [eos] cls3 - sp3 : -18.16 -2.02 10 1.00 [bos] ! ! ! the ! ! ! ) [eos] cls3 - sp4 : -18.52 -2.06 10 0.89 [bos] ! ! ! the ! ! ! ) [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-328 src: none none 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt0: mod/noi/dif/loss/nce/logp -53.39 /-1.14 /-52.25 /2.16/-2.16 -4.85 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt1: mod/noi/dif/loss/nce/logp -53.39 /-1.14 /-52.25 / /-2.16 -4.85 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.27 /-12.10 /-73.17 / /-23.08 -8.53 /-1.21 11 [bos] `` let's talk about books '' , moreland said [eos] tgt3: mod/noi/dif/loss/nce/logp -90.77 /-12.32 /-78.44 / /-28.35 -7.56 /-1.03 13 [bos] `` let's talk about books '' , moreland said . . [eos] tgt4: mod/noi/dif/loss/nce/logp -61.61 /-11.26 /-50.35 / /-0.26 -5.60 /-1.02 12 [bos] `` let's talk about books '' , moreland `` . [eos] tgt5: mod/noi/dif/loss/nce/logp -154.72/-12.31 /-142.41/ /-92.32 -19.34/-1.54 9 [bos] `` let's talk about books '' . [eos] cls0 - sp0 : -11.80 -2.36 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.92 -2.38 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -12.94 -2.59 6 0.20 [bos] ! ! ! ; [eos] cls0 - sp3 : -13.00 -2.60 6 0.20 [bos] '' any ! ! [eos] cls0 - sp4 : -13.13 -2.63 6 0.20 [bos] ! ! ! ; [eos] cls1 - sp0 : -11.14 -2.23 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.16 -2.23 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.67 -2.33 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -12.02 -2.40 6 0.40 [bos] ! ! ! ; [eos] cls1 - sp4 : -12.29 -2.46 6 0.40 [bos] ! ! ! about [eos] cls2 - sp0 : -10.50 -2.10 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -10.99 -2.20 6 0.60 [bos] ! ! ! about [eos] cls2 - sp2 : -11.34 -2.27 6 0.60 [bos] ! ! ! ; [eos] cls2 - sp3 : -11.52 -2.30 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -11.62 -2.32 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -10.20 -2.04 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -10.20 -2.04 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -10.43 -2.09 6 0.80 [bos] ! ! ! about [eos] cls3 - sp3 : -10.81 -2.16 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -11.20 -2.24 6 0.80 [bos] ! ! ! ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-329 src: none none 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt0: mod/noi/dif/loss/nce/logp -52.86 /-1.14 /-51.72 /1.76/-1.76 -4.81 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt1: mod/noi/dif/loss/nce/logp -52.86 /-1.14 /-51.72 / /-1.76 -4.81 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt2: mod/noi/dif/loss/nce/logp -87.54 /-12.10 /-75.44 / /-25.48 -8.75 /-1.21 11 [bos] `` let's talk about books '' , moreland said [eos] tgt3: mod/noi/dif/loss/nce/logp -91.57 /-12.32 /-79.24 / /-29.28 -7.63 /-1.03 13 [bos] `` let's talk about books '' , moreland said . . [eos] tgt4: mod/noi/dif/loss/nce/logp -61.64 /-11.26 /-50.38 / /-0.42 -5.60 /-1.02 12 [bos] `` let's talk about books '' , moreland `` . [eos] tgt5: mod/noi/dif/loss/nce/logp -117.93/-12.31 /-105.62/ /-55.67 -14.74/-1.54 9 [bos] `` let's talk about books '' . [eos] cls0 - sp0 : -11.80 -2.36 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.92 -2.38 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -12.94 -2.59 6 0.20 [bos] ! ! ! ; [eos] cls0 - sp3 : -13.00 -2.60 6 0.20 [bos] '' any ! ! [eos] cls0 - sp4 : -13.13 -2.63 6 0.20 [bos] ! ! ! ; [eos] cls1 - sp0 : -11.14 -2.23 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.16 -2.23 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.67 -2.33 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -12.02 -2.40 6 0.40 [bos] ! ! ! ; [eos] cls1 - sp4 : -12.29 -2.46 6 0.40 [bos] ! ! ! about [eos] cls2 - sp0 : -10.50 -2.10 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -10.99 -2.20 6 0.60 [bos] ! ! ! about [eos] cls2 - sp2 : -11.34 -2.27 6 0.60 [bos] ! ! ! ; [eos] cls2 - sp3 : -11.52 -2.30 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -11.62 -2.32 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -10.20 -2.04 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp1 : -10.20 -2.04 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -10.43 -2.09 6 0.80 [bos] ! ! ! about [eos] cls3 - sp3 : -10.81 -2.16 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -11.20 -2.24 6 0.80 [bos] ! ! ! ; [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-330 src: none none 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt0: mod/noi/dif/loss/nce/logp -54.57 /-1.14 /-53.43 /1.74/-1.74 -4.96 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt1: mod/noi/dif/loss/nce/logp -54.57 /-1.14 /-53.43 / /-1.74 -4.96 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.07 /-12.10 /-72.98 / /-21.28 -8.51 /-1.21 11 [bos] `` let's talk about books '' , moreland said [eos] tgt3: mod/noi/dif/loss/nce/logp -90.28 /-12.32 /-77.96 / /-26.26 -7.52 /-1.03 13 [bos] `` let's talk about books '' , moreland said . . [eos] tgt4: mod/noi/dif/loss/nce/logp -63.39 /-11.26 /-52.13 / /-0.43 -5.76 /-1.02 12 [bos] `` let's talk about books '' , moreland `` . [eos] tgt5: mod/noi/dif/loss/nce/logp -114.10/-12.31 /-101.79/ /-50.10 -14.26/-1.54 9 [bos] `` let's talk about books '' . [eos] cls0 - sp0 : -10.49 -2.10 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -10.63 -2.13 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp2 : -10.74 -2.15 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -11.46 -2.29 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -12.09 -2.42 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -10.00 -2.00 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.12 -2.22 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.55 -2.31 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -11.57 -2.31 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -11.77 -2.35 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -10.64 -2.13 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -10.65 -2.13 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.48 -2.30 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -16.21 -1.80 10 0.56 [bos] ! ! ! ! ! '' , ! [eos] cls2 - sp4 : -16.59 -1.84 10 0.56 [bos] ! ! ! ! ! '' , ! [eos] cls3 - sp0 : -10.43 -2.09 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -15.14 -1.68 10 0.89 [bos] ! ! ! ! ! '' , ! [eos] cls3 - sp2 : -15.18 -1.69 10 1.00 [bos] ! ! ! ! ! '' , ! [eos] cls3 - sp3 : -16.72 -1.52 12 0.91 [bos] ! ! ! ! ! '' , later out . [eos] cls3 - sp4 : -16.80 -1.53 12 0.91 [bos] ! ! ! ! ! '' , don't had . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-331 src: none none 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt0: mod/noi/dif/loss/nce/logp -54.66 /-1.14 /-53.52 /1.61/-1.61 -4.97 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt1: mod/noi/dif/loss/nce/logp -54.66 /-1.14 /-53.52 / /-1.61 -4.97 /-0.10 12 [bos] `` let's talk about books '' , moreland said . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.01 /-12.10 /-73.91 / /-22.00 -8.60 /-1.21 11 [bos] `` let's talk about books '' , moreland said [eos] tgt3: mod/noi/dif/loss/nce/logp -92.54 /-12.32 /-80.21 / /-28.31 -7.71 /-1.03 13 [bos] `` let's talk about books '' , moreland said . . [eos] tgt4: mod/noi/dif/loss/nce/logp -63.67 /-11.26 /-52.41 / /-0.51 -5.79 /-1.02 12 [bos] `` let's talk about books '' , moreland `` . [eos] tgt5: mod/noi/dif/loss/nce/logp -98.88 /-12.31 /-86.57 / /-34.66 -12.36/-1.54 9 [bos] `` let's talk about books '' . [eos] cls0 - sp0 : -10.49 -2.10 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -10.63 -2.13 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp2 : -10.74 -2.15 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -11.46 -2.29 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -12.09 -2.42 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -10.00 -2.00 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.12 -2.22 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.55 -2.31 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -11.57 -2.31 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -11.77 -2.35 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -10.64 -2.13 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -10.65 -2.13 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.48 -2.30 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -16.21 -1.80 10 0.56 [bos] ! ! ! ! ! '' , ! [eos] cls2 - sp4 : -16.59 -1.84 10 0.56 [bos] ! ! ! ! ! '' , ! [eos] cls3 - sp0 : -10.43 -2.09 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -15.14 -1.68 10 0.89 [bos] ! ! ! ! ! '' , ! [eos] cls3 - sp2 : -15.18 -1.69 10 1.00 [bos] ! ! ! ! ! '' , ! [eos] cls3 - sp3 : -16.72 -1.52 12 0.91 [bos] ! ! ! ! ! '' , later out . [eos] cls3 - sp4 : -16.80 -1.53 12 0.91 [bos] ! ! ! ! ! '' , don't had . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-332 src: none none 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -87.44 /-2.67 /-84.76 /0.69/-0.69 -3.64 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -87.44 /-2.67 /-84.76 / /-0.69 -3.64 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -147.42/-13.00 /-134.42/ /-50.35 -6.41 /-0.57 24 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? [eos] tgt3: mod/noi/dif/loss/nce/logp -296.09/-12.46 /-283.62/ /-199.55 -37.01/-1.56 9 [bos] `` they require , for existence . [eos] tgt4: mod/noi/dif/loss/nce/logp -318.73/-13.29 /-305.45/ /-221.38 -19.92/-0.83 17 [bos] `` they require , for existence , a brave spirit and a high heart . [eos] tgt5: mod/noi/dif/loss/nce/logp -104.34/-13.40 /-90.93 / /-6.86 -4.35 /-0.56 25 [bos] `` they require , , existence , a brave spirit and a high heart , and where do you find these ? ? [eos] cls0 - sp0 : -41.59 -1.73 25 0.00 [bos] : has first , is joined , a cleaning made and a all streets , and were all you or not an an [eos] cls0 - sp1 : -41.71 -1.74 25 0.00 [bos] : has first , is joined , a cleaning made and a all streets , and were first you or not an an [eos] cls0 - sp2 : -41.73 -1.74 25 0.00 [bos] : has first , is joined , a joined made and a all streets , and were all you or not an an [eos] cls0 - sp3 : -41.74 -1.74 25 0.00 [bos] : has first , is joined , a cleaning made and a all streets , and were she you or not an an [eos] cls0 - sp4 : -41.81 -1.74 25 0.00 [bos] : has streets , is joined , a cleaning made and a all streets , and were all you or not an an [eos] cls1 - sp0 : -51.12 -2.13 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a all when , and were all you or which an an [eos] cls1 - sp1 : -51.19 -2.13 25 0.25 [bos] '' has don't , is personal , a cleaning made and a all when , and were all you or which an an [eos] cls1 - sp2 : -51.26 -2.14 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a all when , and were she you or which an an [eos] cls1 - sp3 : -51.27 -2.14 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a all when , and were first you or which an an [eos] cls1 - sp4 : -51.30 -2.14 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a streets when , and were all you or which an an [eos] cls2 - sp0 : -51.87 -2.16 25 0.71 [bos] '' has don't , is personal , a 7 ? and a telephone when , and were she you or which ? ? [eos] cls2 - sp1 : -51.90 -2.16 25 0.71 [bos] '' has don't , is personal , a 7 ? and a telephone telephone , and were she you or which ? ? [eos] cls2 - sp2 : -52.17 -2.17 25 0.71 [bos] '' has don't , is personal , a 7 ? and a telephone when , and were she you or not ? ? [eos] cls2 - sp3 : -52.32 -2.18 25 0.54 [bos] '' has don't , is personal , a 7 ? and a telephone telephone , and were she you or not ? ? [eos] cls2 - sp4 : -52.37 -2.18 25 0.54 [bos] '' has don't , is personal , a 7 ? and a telephone when , and were she you or not ? ? [eos] cls3 - sp0 : -44.76 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone telephone , and were all you or not an an [eos] cls3 - sp1 : -44.77 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone thought , and were all you or not an an [eos] cls3 - sp2 : -44.84 -1.87 25 1.00 [bos] she they united , is personal , a telephone made and a telephone thought , and were all you or not an an [eos] cls3 - sp3 : -44.84 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone thought , and were thought you or not an an [eos] cls3 - sp4 : -44.85 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone telephone , and were thought you or not an an [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-333 src: none none 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -90.13 /-2.67 /-87.45 /0.69/-0.69 -3.76 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -90.13 /-2.67 /-87.45 / /-0.69 -3.76 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -144.06/-13.00 /-131.06/ /-44.30 -6.26 /-0.57 24 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? [eos] tgt3: mod/noi/dif/loss/nce/logp -292.54/-12.46 /-280.07/ /-193.31 -36.57/-1.56 9 [bos] `` they require , for existence . [eos] tgt4: mod/noi/dif/loss/nce/logp -314.25/-13.29 /-300.96/ /-214.20 -19.64/-0.83 17 [bos] `` they require , for existence , a brave spirit and a high heart . [eos] tgt5: mod/noi/dif/loss/nce/logp -107.33/-13.40 /-93.93 / /-7.17 -4.47 /-0.56 25 [bos] `` they require , , existence , a brave spirit and a high heart , and where do you find these ? ? [eos] cls0 - sp0 : -41.59 -1.73 25 0.00 [bos] : has first , is joined , a cleaning made and a all streets , and were all you or not an an [eos] cls0 - sp1 : -41.71 -1.74 25 0.00 [bos] : has first , is joined , a cleaning made and a all streets , and were first you or not an an [eos] cls0 - sp2 : -41.73 -1.74 25 0.00 [bos] : has first , is joined , a joined made and a all streets , and were all you or not an an [eos] cls0 - sp3 : -41.74 -1.74 25 0.00 [bos] : has first , is joined , a cleaning made and a all streets , and were she you or not an an [eos] cls0 - sp4 : -41.81 -1.74 25 0.00 [bos] : has streets , is joined , a cleaning made and a all streets , and were all you or not an an [eos] cls1 - sp0 : -51.12 -2.13 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a all when , and were all you or which an an [eos] cls1 - sp1 : -51.19 -2.13 25 0.25 [bos] '' has don't , is personal , a cleaning made and a all when , and were all you or which an an [eos] cls1 - sp2 : -51.26 -2.14 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a all when , and were she you or which an an [eos] cls1 - sp3 : -51.27 -2.14 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a all when , and were first you or which an an [eos] cls1 - sp4 : -51.30 -2.14 25 0.25 [bos] '' has don't , is personal , a cleaning ? and a streets when , and were all you or which an an [eos] cls2 - sp0 : -51.87 -2.16 25 0.71 [bos] '' has don't , is personal , a 7 ? and a telephone when , and were she you or which ? ? [eos] cls2 - sp1 : -51.90 -2.16 25 0.71 [bos] '' has don't , is personal , a 7 ? and a telephone telephone , and were she you or which ? ? [eos] cls2 - sp2 : -52.17 -2.17 25 0.71 [bos] '' has don't , is personal , a 7 ? and a telephone when , and were she you or not ? ? [eos] cls2 - sp3 : -52.32 -2.18 25 0.54 [bos] '' has don't , is personal , a 7 ? and a telephone telephone , and were she you or not ? ? [eos] cls2 - sp4 : -52.37 -2.18 25 0.54 [bos] '' has don't , is personal , a 7 ? and a telephone when , and were she you or not ? ? [eos] cls3 - sp0 : -44.76 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone telephone , and were all you or not an an [eos] cls3 - sp1 : -44.77 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone thought , and were all you or not an an [eos] cls3 - sp2 : -44.84 -1.87 25 1.00 [bos] she they united , is personal , a telephone made and a telephone thought , and were all you or not an an [eos] cls3 - sp3 : -44.84 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone thought , and were thought you or not an an [eos] cls3 - sp4 : -44.85 -1.87 25 1.00 [bos] she they corner , is personal , a telephone made and a telephone telephone , and were thought you or not an an [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-334 src: none none 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -87.92 /-2.67 /-85.25 /0.69/-0.69 -3.66 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -87.92 /-2.67 /-85.25 / /-0.69 -3.66 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -139.36/-13.00 /-126.36/ /-41.81 -6.06 /-0.57 24 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? [eos] tgt3: mod/noi/dif/loss/nce/logp -294.08/-12.46 /-281.62/ /-197.07 -36.76/-1.56 9 [bos] `` they require , for existence . [eos] tgt4: mod/noi/dif/loss/nce/logp -311.45/-13.29 /-298.16/ /-213.61 -19.47/-0.83 17 [bos] `` they require , for existence , a brave spirit and a high heart . [eos] tgt5: mod/noi/dif/loss/nce/logp -104.60/-13.40 /-91.20 / /-6.65 -4.36 /-0.56 25 [bos] `` they require , , existence , a brave spirit and a high heart , and where do you find these ? ? [eos] cls0 - sp0 : -40.83 -1.70 25 0.00 [bos] : has most , is joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp1 : -40.87 -1.70 25 0.00 [bos] '' has any , to joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp2 : -40.89 -1.70 25 0.00 [bos] : has any , to joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp3 : -40.97 -1.71 25 0.00 [bos] : has any , is joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp4 : -41.03 -1.71 25 0.00 [bos] '' has any , to joined , a cleaning joined and a all she , and they be you i not ? ? [eos] cls1 - sp0 : -50.09 -2.09 25 0.25 [bos] '' has any , is telephone , a cleaning pain and a she when , and they be you he ! ? ? [eos] cls1 - sp1 : -50.12 -2.09 25 0.46 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! you he not ? ? [eos] cls1 - sp2 : -50.13 -2.09 25 0.25 [bos] '' has any , is telephone , a cleaning pain and a she when , and they be you but ! ? ? [eos] cls1 - sp3 : -50.18 -2.09 25 0.25 [bos] '' has any , is telephone , a cleaning pain and a she she , and they not you but ! ? ? [eos] cls1 - sp4 : -50.21 -2.09 25 0.46 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! you i not ? ? [eos] cls2 - sp0 : -49.86 -2.08 25 0.58 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! ! i not ? ? [eos] cls2 - sp1 : -49.90 -2.08 25 0.54 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! you he not ? ? [eos] cls2 - sp2 : -49.92 -2.08 25 0.58 [bos] '' has any , for telephone , a telephone corner and a she when , and were ! ! i not ? ? [eos] cls2 - sp3 : -50.01 -2.08 25 0.54 [bos] '' has any , for telephone , a telephone corner and a she when , and were ! you he not ? ? [eos] cls2 - sp4 : -50.09 -2.09 25 0.50 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! ! i not ? ? [eos] cls3 - sp0 : -44.17 -1.84 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone she , and they be you he not ? ? [eos] cls3 - sp1 : -44.32 -1.85 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone she , and they all you he not ? ? [eos] cls3 - sp2 : -44.35 -1.85 25 1.00 [bos] she they personal , to thought , a telephone corner and a telephone she , and they be you he not ? ? [eos] cls3 - sp3 : -44.36 -1.85 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone when , and they be you he not ? ? [eos] cls3 - sp4 : -44.37 -1.85 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone thought , and they be you he not ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-335 src: none none 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt0: mod/noi/dif/loss/nce/logp -91.86 /-2.67 /-89.19 /0.69/-0.69 -3.83 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt1: mod/noi/dif/loss/nce/logp -91.86 /-2.67 /-89.19 / /-0.69 -3.83 /-0.11 25 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? ? [eos] tgt2: mod/noi/dif/loss/nce/logp -137.75/-13.00 /-124.74/ /-36.25 -5.99 /-0.57 24 [bos] `` they require , for existence , a brave spirit and a high heart , and where do you find these ? [eos] tgt3: mod/noi/dif/loss/nce/logp -289.52/-12.46 /-277.06/ /-188.57 -36.19/-1.56 9 [bos] `` they require , for existence . [eos] tgt4: mod/noi/dif/loss/nce/logp -312.12/-13.29 /-298.83/ /-210.34 -19.51/-0.83 17 [bos] `` they require , for existence , a brave spirit and a high heart . [eos] tgt5: mod/noi/dif/loss/nce/logp -108.99/-13.40 /-95.58 / /-7.09 -4.54 /-0.56 25 [bos] `` they require , , existence , a brave spirit and a high heart , and where do you find these ? ? [eos] cls0 - sp0 : -40.83 -1.70 25 0.00 [bos] : has most , is joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp1 : -40.87 -1.70 25 0.00 [bos] '' has any , to joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp2 : -40.89 -1.70 25 0.00 [bos] : has any , to joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp3 : -40.97 -1.71 25 0.00 [bos] : has any , is joined , a cleaning joined and a she she , and they be you i not ? ? [eos] cls0 - sp4 : -41.03 -1.71 25 0.00 [bos] '' has any , to joined , a cleaning joined and a all she , and they be you i not ? ? [eos] cls1 - sp0 : -50.09 -2.09 25 0.25 [bos] '' has any , is telephone , a cleaning pain and a she when , and they be you he ! ? ? [eos] cls1 - sp1 : -50.12 -2.09 25 0.46 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! you he not ? ? [eos] cls1 - sp2 : -50.13 -2.09 25 0.25 [bos] '' has any , is telephone , a cleaning pain and a she when , and they be you but ! ? ? [eos] cls1 - sp3 : -50.18 -2.09 25 0.25 [bos] '' has any , is telephone , a cleaning pain and a she she , and they not you but ! ? ? [eos] cls1 - sp4 : -50.21 -2.09 25 0.46 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! you i not ? ? [eos] cls2 - sp0 : -49.86 -2.08 25 0.58 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! ! i not ? ? [eos] cls2 - sp1 : -49.90 -2.08 25 0.54 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! you he not ? ? [eos] cls2 - sp2 : -49.92 -2.08 25 0.58 [bos] '' has any , for telephone , a telephone corner and a she when , and were ! ! i not ? ? [eos] cls2 - sp3 : -50.01 -2.08 25 0.54 [bos] '' has any , for telephone , a telephone corner and a she when , and were ! you he not ? ? [eos] cls2 - sp4 : -50.09 -2.09 25 0.50 [bos] '' has any , for telephone , a telephone corner and a she she , and were ! ! i not ? ? [eos] cls3 - sp0 : -44.17 -1.84 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone she , and they be you he not ? ? [eos] cls3 - sp1 : -44.32 -1.85 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone she , and they all you he not ? ? [eos] cls3 - sp2 : -44.35 -1.85 25 1.00 [bos] she they personal , to thought , a telephone corner and a telephone she , and they be you he not ? ? [eos] cls3 - sp3 : -44.36 -1.85 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone when , and they be you he not ? ? [eos] cls3 - sp4 : -44.37 -1.85 25 1.00 [bos] she they personal , to corner , a telephone corner and a telephone thought , and they be you he not ? ? [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-336 src: none none 5 [bos] he asked . [eos] tgt0: mod/noi/dif/loss/nce/logp -14.75 /-0.49 /-14.26 /0.71/-0.71 -3.69 /-0.12 5 [bos] he asked . [eos] tgt1: mod/noi/dif/loss/nce/logp -14.75 /-0.49 /-14.26 / /-0.71 -3.69 /-0.12 5 [bos] he asked . [eos] tgt2: mod/noi/dif/loss/nce/logp -46.88 /-11.40 /-35.47 / /-21.93 -15.63/-3.80 4 [bos] he asked [eos] tgt3: mod/noi/dif/loss/nce/logp -51.35 /-11.66 /-39.69 / /-26.15 -10.27/-2.33 6 [bos] he asked . . [eos] tgt4: mod/noi/dif/loss/nce/logp -38.33 /-11.98 /-26.35 / /-12.81 -9.58 /-2.99 5 [bos] he asked , [eos] tgt5: mod/noi/dif/loss/nce/logp -28.90 /-11.44 /-17.47 / /-3.92 -7.23 /-2.86 5 [bos] and asked . [eos] cls0 - sp0 : -5.55 -1.39 5 0.00 [bos] ! ! . [eos] cls0 - sp1 : -6.00 -1.50 5 0.00 [bos] i no . [eos] cls0 - sp2 : -6.07 -1.52 5 0.00 [bos] i any . [eos] cls0 - sp3 : -6.47 -1.62 5 0.00 [bos] i later . [eos] cls0 - sp4 : -6.63 -1.66 5 0.00 [bos] we any . [eos] cls1 - sp0 : -4.14 -1.04 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -5.40 -1.35 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -6.45 -1.61 5 0.25 [bos] ! later . [eos] cls1 - sp3 : -6.66 -1.66 5 0.25 [bos] ! property . [eos] cls1 - sp4 : -6.82 -1.70 5 0.25 [bos] ! couldn't . [eos] cls2 - sp0 : -3.74 -0.93 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -6.91 -1.73 5 0.50 [bos] ! me . [eos] cls2 - sp2 : -6.99 -1.75 5 0.50 [bos] ! ! . [eos] cls2 - sp3 : -7.15 -1.79 5 0.50 [bos] ! property . [eos] cls2 - sp4 : -7.22 -1.81 5 0.50 [bos] ! ! or [eos] cls3 - sp0 : -4.74 -1.18 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -6.39 -1.60 5 0.75 [bos] we later . [eos] cls3 - sp2 : -6.54 -1.64 5 0.75 [bos] ! later . [eos] cls3 - sp3 : -6.55 -1.64 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -7.00 -1.75 5 0.75 [bos] we ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-337 src: none none 5 [bos] he asked . [eos] tgt0: mod/noi/dif/loss/nce/logp -20.62 /-0.49 /-20.14 /0.72/-0.72 -5.16 /-0.12 5 [bos] he asked . [eos] tgt1: mod/noi/dif/loss/nce/logp -20.62 /-0.49 /-20.14 / /-0.72 -5.16 /-0.12 5 [bos] he asked . [eos] tgt2: mod/noi/dif/loss/nce/logp -57.79 /-11.40 /-46.38 / /-26.97 -19.26/-3.80 4 [bos] he asked [eos] tgt3: mod/noi/dif/loss/nce/logp -57.81 /-11.66 /-46.15 / /-26.73 -11.56/-2.33 6 [bos] he asked . . [eos] tgt4: mod/noi/dif/loss/nce/logp -47.17 /-11.98 /-35.19 / /-15.77 -11.79/-2.99 5 [bos] he asked , [eos] tgt5: mod/noi/dif/loss/nce/logp -34.56 /-11.44 /-23.13 / /-3.71 -8.64 /-2.86 5 [bos] and asked . [eos] cls0 - sp0 : -5.55 -1.39 5 0.00 [bos] ! ! . [eos] cls0 - sp1 : -6.00 -1.50 5 0.00 [bos] i no . [eos] cls0 - sp2 : -6.07 -1.52 5 0.00 [bos] i any . [eos] cls0 - sp3 : -6.47 -1.62 5 0.00 [bos] i later . [eos] cls0 - sp4 : -6.63 -1.66 5 0.00 [bos] we any . [eos] cls1 - sp0 : -4.14 -1.04 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -5.40 -1.35 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -6.45 -1.61 5 0.25 [bos] ! later . [eos] cls1 - sp3 : -6.66 -1.66 5 0.25 [bos] ! property . [eos] cls1 - sp4 : -6.82 -1.70 5 0.25 [bos] ! couldn't . [eos] cls2 - sp0 : -3.74 -0.93 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -6.91 -1.73 5 0.50 [bos] ! me . [eos] cls2 - sp2 : -6.99 -1.75 5 0.50 [bos] ! ! . [eos] cls2 - sp3 : -7.15 -1.79 5 0.50 [bos] ! property . [eos] cls2 - sp4 : -7.22 -1.81 5 0.50 [bos] ! ! or [eos] cls3 - sp0 : -4.74 -1.18 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -6.39 -1.60 5 0.75 [bos] we later . [eos] cls3 - sp2 : -6.54 -1.64 5 0.75 [bos] ! later . [eos] cls3 - sp3 : -6.55 -1.64 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -7.00 -1.75 5 0.75 [bos] we ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-338 src: none none 5 [bos] he asked . [eos] tgt0: mod/noi/dif/loss/nce/logp -14.55 /-0.49 /-14.06 /0.71/-0.71 -3.64 /-0.12 5 [bos] he asked . [eos] tgt1: mod/noi/dif/loss/nce/logp -14.55 /-0.49 /-14.06 / /-0.71 -3.64 /-0.12 5 [bos] he asked . [eos] tgt2: mod/noi/dif/loss/nce/logp -48.18 /-11.40 /-36.78 / /-23.43 -16.06/-3.80 4 [bos] he asked [eos] tgt3: mod/noi/dif/loss/nce/logp -49.93 /-11.66 /-38.27 / /-24.92 -9.99 /-2.33 6 [bos] he asked . . [eos] tgt4: mod/noi/dif/loss/nce/logp -38.08 /-11.98 /-26.11 / /-12.75 -9.52 /-2.99 5 [bos] he asked , [eos] tgt5: mod/noi/dif/loss/nce/logp -29.16 /-11.44 /-17.72 / /-4.37 -7.29 /-2.86 5 [bos] and asked . [eos] cls0 - sp0 : -5.43 -1.36 5 0.00 [bos] i no . [eos] cls0 - sp1 : -5.80 -1.45 5 0.00 [bos] i any . [eos] cls0 - sp2 : -6.17 -1.54 5 0.00 [bos] she any . [eos] cls0 - sp3 : -6.19 -1.55 5 0.00 [bos] she no . [eos] cls0 - sp4 : -6.41 -1.60 5 0.00 [bos] i later . [eos] cls1 - sp0 : -5.30 -1.33 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -5.94 -1.49 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -6.34 -1.58 5 0.25 [bos] ! ) . [eos] cls1 - sp3 : -6.47 -1.62 5 0.25 [bos] ! no . [eos] cls1 - sp4 : -6.75 -1.69 5 0.25 [bos] ! later . [eos] cls2 - sp0 : -4.49 -1.12 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -6.45 -1.61 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -6.82 -1.71 5 0.50 [bos] ! ) . [eos] cls2 - sp3 : -7.29 -1.82 5 0.50 [bos] ! later . [eos] cls2 - sp4 : -7.36 -1.84 5 0.50 [bos] ! property . [eos] cls3 - sp0 : -6.19 -1.55 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -6.59 -1.65 5 0.75 [bos] she no . [eos] cls3 - sp2 : -6.70 -1.68 5 0.75 [bos] we no . [eos] cls3 - sp3 : -6.79 -1.70 5 0.75 [bos] we later . [eos] cls3 - sp4 : -6.82 -1.70 5 0.75 [bos] ! no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-339 src: none none 5 [bos] he asked . [eos] tgt0: mod/noi/dif/loss/nce/logp -20.76 /-0.49 /-20.27 /0.71/-0.71 -5.19 /-0.12 5 [bos] he asked . [eos] tgt1: mod/noi/dif/loss/nce/logp -20.76 /-0.49 /-20.27 / /-0.71 -5.19 /-0.12 5 [bos] he asked . [eos] tgt2: mod/noi/dif/loss/nce/logp -59.39 /-11.40 /-47.99 / /-28.44 -19.80/-3.80 4 [bos] he asked [eos] tgt3: mod/noi/dif/loss/nce/logp -56.80 /-11.66 /-45.14 / /-25.58 -11.36/-2.33 6 [bos] he asked . . [eos] tgt4: mod/noi/dif/loss/nce/logp -49.95 /-11.98 /-37.98 / /-18.42 -12.49/-2.99 5 [bos] he asked , [eos] tgt5: mod/noi/dif/loss/nce/logp -34.99 /-11.44 /-23.55 / /-4.00 -8.75 /-2.86 5 [bos] and asked . [eos] cls0 - sp0 : -5.43 -1.36 5 0.00 [bos] i no . [eos] cls0 - sp1 : -5.80 -1.45 5 0.00 [bos] i any . [eos] cls0 - sp2 : -6.17 -1.54 5 0.00 [bos] she any . [eos] cls0 - sp3 : -6.19 -1.55 5 0.00 [bos] she no . [eos] cls0 - sp4 : -6.41 -1.60 5 0.00 [bos] i later . [eos] cls1 - sp0 : -5.30 -1.33 5 0.25 [bos] ! ! . [eos] cls1 - sp1 : -5.94 -1.49 5 0.25 [bos] ! ! . [eos] cls1 - sp2 : -6.34 -1.58 5 0.25 [bos] ! ) . [eos] cls1 - sp3 : -6.47 -1.62 5 0.25 [bos] ! no . [eos] cls1 - sp4 : -6.75 -1.69 5 0.25 [bos] ! later . [eos] cls2 - sp0 : -4.49 -1.12 5 0.50 [bos] ! ! . [eos] cls2 - sp1 : -6.45 -1.61 5 0.50 [bos] ! no . [eos] cls2 - sp2 : -6.82 -1.71 5 0.50 [bos] ! ) . [eos] cls2 - sp3 : -7.29 -1.82 5 0.50 [bos] ! later . [eos] cls2 - sp4 : -7.36 -1.84 5 0.50 [bos] ! property . [eos] cls3 - sp0 : -6.19 -1.55 5 0.75 [bos] ! ! . [eos] cls3 - sp1 : -6.59 -1.65 5 0.75 [bos] she no . [eos] cls3 - sp2 : -6.70 -1.68 5 0.75 [bos] we no . [eos] cls3 - sp3 : -6.79 -1.70 5 0.75 [bos] we later . [eos] cls3 - sp4 : -6.82 -1.70 5 0.75 [bos] ! no . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-340 src: none none 9 [bos] he looked so comfortable being straight . [eos] tgt0: mod/noi/dif/loss/nce/logp -43.30 /-0.82 /-42.47 /4.32/-4.32 -5.41 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt1: mod/noi/dif/loss/nce/logp -43.30 /-0.82 /-42.47 / /-4.32 -5.41 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt2: mod/noi/dif/loss/nce/logp -72.54 /-11.81 /-60.73 / /-22.57 -10.36/-1.69 8 [bos] he looked so comfortable being straight [eos] tgt3: mod/noi/dif/loss/nce/logp -50.53 /-11.94 /-38.58 / /-0.43 -6.32 /-1.49 9 [bos] he looked so comfortable being undoubtedly . [eos] tgt4: mod/noi/dif/loss/nce/logp -80.15 /-12.03 /-68.12 / /-29.96 -8.91 /-1.34 10 [bos] he looked so comfortable being straight . . [eos] tgt5: mod/noi/dif/loss/nce/logp -51.34 /-12.06 /-39.28 / /-1.13 -6.42 /-1.51 9 [bos] he looked so comfortable being journalism . [eos] cls0 - sp0 : -8.07 -2.02 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -8.15 -2.04 5 0.00 [bos] i no ! [eos] cls0 - sp2 : -12.17 -2.43 6 0.20 [bos] i no ! ! [eos] cls0 - sp3 : -12.64 -2.53 6 0.20 [bos] ! ! are ! [eos] cls0 - sp4 : -12.92 -2.58 6 0.20 [bos] ! ! so ! [eos] cls1 - sp0 : -6.99 -1.75 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -7.85 -1.96 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -8.52 -2.13 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -9.03 -2.26 5 0.25 [bos] ! ) ! [eos] cls1 - sp4 : -9.28 -2.32 5 0.25 [bos] ! no ! [eos] cls2 - sp0 : -6.03 -1.51 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -7.22 -1.81 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -8.06 -2.02 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -8.96 -2.24 5 0.50 [bos] ! no ! [eos] cls2 - sp4 : -8.99 -2.25 5 0.50 [bos] ! 7 ! [eos] cls3 - sp0 : -6.12 -1.53 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -6.72 -1.68 5 1.00 [bos] ! ! ! [eos] cls3 - sp2 : -7.50 -1.88 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -8.57 -2.14 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -8.82 -2.20 5 0.75 [bos] ! no ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-341 src: none none 9 [bos] he looked so comfortable being straight . [eos] tgt0: mod/noi/dif/loss/nce/logp -53.17 /-0.82 /-52.34 /8.29/-8.29 -6.65 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt1: mod/noi/dif/loss/nce/logp -53.17 /-0.82 /-52.34 / /-8.29 -6.65 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.46 /-11.81 /-74.64 / /-30.59 -12.35/-1.69 8 [bos] he looked so comfortable being straight [eos] tgt3: mod/noi/dif/loss/nce/logp -56.13 /-11.94 /-44.18 / /-0.13 -7.02 /-1.49 9 [bos] he looked so comfortable being undoubtedly . [eos] tgt4: mod/noi/dif/loss/nce/logp -90.89 /-12.03 /-78.85 / /-34.80 -10.10/-1.34 10 [bos] he looked so comfortable being straight . . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.22 /-12.06 /-46.17 / /-2.11 -7.28 /-1.51 9 [bos] he looked so comfortable being journalism . [eos] cls0 - sp0 : -8.07 -2.02 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -8.15 -2.04 5 0.00 [bos] i no ! [eos] cls0 - sp2 : -12.17 -2.43 6 0.20 [bos] i no ! ! [eos] cls0 - sp3 : -12.64 -2.53 6 0.20 [bos] ! ! are ! [eos] cls0 - sp4 : -12.92 -2.58 6 0.20 [bos] ! ! so ! [eos] cls1 - sp0 : -6.99 -1.75 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -7.85 -1.96 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -8.52 -2.13 5 0.25 [bos] ! ! ! [eos] cls1 - sp3 : -9.03 -2.26 5 0.25 [bos] ! ) ! [eos] cls1 - sp4 : -9.28 -2.32 5 0.25 [bos] ! no ! [eos] cls2 - sp0 : -6.03 -1.51 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -7.22 -1.81 5 0.50 [bos] ! ! ! [eos] cls2 - sp2 : -8.06 -2.02 5 0.50 [bos] ! ! ! [eos] cls2 - sp3 : -8.96 -2.24 5 0.50 [bos] ! no ! [eos] cls2 - sp4 : -8.99 -2.25 5 0.50 [bos] ! 7 ! [eos] cls3 - sp0 : -6.12 -1.53 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -6.72 -1.68 5 1.00 [bos] ! ! ! [eos] cls3 - sp2 : -7.50 -1.88 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -8.57 -2.14 5 0.75 [bos] ! ! ! [eos] cls3 - sp4 : -8.82 -2.20 5 0.75 [bos] ! no ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-342 src: none none 9 [bos] he looked so comfortable being straight . [eos] tgt0: mod/noi/dif/loss/nce/logp -44.12 /-0.82 /-43.30 /4.57/-4.57 -5.52 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt1: mod/noi/dif/loss/nce/logp -44.12 /-0.82 /-43.30 / /-4.57 -5.52 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt2: mod/noi/dif/loss/nce/logp -73.30 /-11.81 /-61.49 / /-22.76 -10.47/-1.69 8 [bos] he looked so comfortable being straight [eos] tgt3: mod/noi/dif/loss/nce/logp -51.08 /-11.94 /-39.13 / /-0.41 -6.38 /-1.49 9 [bos] he looked so comfortable being undoubtedly . [eos] tgt4: mod/noi/dif/loss/nce/logp -79.39 /-12.03 /-67.35 / /-28.63 -8.82 /-1.34 10 [bos] he looked so comfortable being straight . . [eos] tgt5: mod/noi/dif/loss/nce/logp -51.93 /-12.06 /-39.88 / /-1.15 -6.49 /-1.51 9 [bos] he looked so comfortable being journalism . [eos] cls0 - sp0 : -6.06 -1.51 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -6.63 -1.66 5 0.00 [bos] she ! ! [eos] cls0 - sp2 : -7.27 -1.82 5 0.00 [bos] we ! ! [eos] cls0 - sp3 : -8.14 -2.04 5 0.00 [bos] i ! ! [eos] cls0 - sp4 : -8.85 -1.77 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -5.25 -1.31 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -6.31 -1.58 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -7.40 -1.85 5 0.25 [bos] she ! ! [eos] cls1 - sp3 : -7.41 -1.85 5 0.25 [bos] she ! ! [eos] cls1 - sp4 : -7.62 -1.52 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -5.00 -1.25 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -6.70 -1.34 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -6.79 -1.70 5 0.50 [bos] she ! ! [eos] cls2 - sp3 : -7.31 -1.46 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -7.33 -1.83 5 0.50 [bos] don't ! ! [eos] cls3 - sp0 : -6.21 -1.55 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -6.23 -1.25 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -6.52 -1.63 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -7.45 -1.86 5 1.00 [bos] ! ! ! [eos] cls3 - sp4 : -7.65 -1.53 6 1.00 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-343 src: none none 9 [bos] he looked so comfortable being straight . [eos] tgt0: mod/noi/dif/loss/nce/logp -53.65 /-0.82 /-52.83 /8.28/-8.28 -6.71 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt1: mod/noi/dif/loss/nce/logp -53.65 /-0.82 /-52.83 / /-8.28 -6.71 /-0.10 9 [bos] he looked so comfortable being straight . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.57 /-11.81 /-73.75 / /-29.20 -12.22/-1.69 8 [bos] he looked so comfortable being straight [eos] tgt3: mod/noi/dif/loss/nce/logp -56.63 /-11.94 /-44.69 / /-0.14 -7.08 /-1.49 9 [bos] he looked so comfortable being undoubtedly . [eos] tgt4: mod/noi/dif/loss/nce/logp -90.56 /-12.03 /-78.53 / /-33.98 -10.06/-1.34 10 [bos] he looked so comfortable being straight . . [eos] tgt5: mod/noi/dif/loss/nce/logp -58.63 /-12.06 /-46.57 / /-2.02 -7.33 /-1.51 9 [bos] he looked so comfortable being journalism . [eos] cls0 - sp0 : -6.06 -1.51 5 0.00 [bos] ! ! ! [eos] cls0 - sp1 : -6.63 -1.66 5 0.00 [bos] she ! ! [eos] cls0 - sp2 : -7.27 -1.82 5 0.00 [bos] we ! ! [eos] cls0 - sp3 : -8.14 -2.04 5 0.00 [bos] i ! ! [eos] cls0 - sp4 : -8.85 -1.77 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -5.25 -1.31 5 0.25 [bos] ! ! ! [eos] cls1 - sp1 : -6.31 -1.58 5 0.25 [bos] ! ! ! [eos] cls1 - sp2 : -7.40 -1.85 5 0.25 [bos] she ! ! [eos] cls1 - sp3 : -7.41 -1.85 5 0.25 [bos] she ! ! [eos] cls1 - sp4 : -7.62 -1.52 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -5.00 -1.25 5 0.50 [bos] ! ! ! [eos] cls2 - sp1 : -6.70 -1.34 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -6.79 -1.70 5 0.50 [bos] she ! ! [eos] cls2 - sp3 : -7.31 -1.46 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -7.33 -1.83 5 0.50 [bos] don't ! ! [eos] cls3 - sp0 : -6.21 -1.55 5 0.75 [bos] ! ! ! [eos] cls3 - sp1 : -6.23 -1.25 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp2 : -6.52 -1.63 5 0.75 [bos] ! ! ! [eos] cls3 - sp3 : -7.45 -1.86 5 1.00 [bos] ! ! ! [eos] cls3 - sp4 : -7.65 -1.53 6 1.00 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-344 src: none none 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt0: mod/noi/dif/loss/nce/logp -69.65 /-1.20 /-68.45 /14.4/-14.40 -5.80 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt1: mod/noi/dif/loss/nce/logp -69.65 /-1.20 /-68.45 / /-14.40 -5.80 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.67 /-12.88 /-73.79 / /-19.74 -7.22 /-1.07 13 [bos] arlene was boosting puts up when the policeman came by . [eos] tgt3: mod/noi/dif/loss/nce/logp -67.63 /-12.94 /-54.69 / /-0.64 -5.64 /-1.08 13 [bos] arlene was transporting them up when the policeman came by . [eos] tgt4: mod/noi/dif/loss/nce/logp -70.57 /-13.21 /-57.36 / /-3.31 -5.88 /-1.10 13 [bos] arlene was scrutinizing them up when the policeman came by . [eos] tgt5: mod/noi/dif/loss/nce/logp -67.71 /-12.84 /-54.88 / /-0.83 -5.64 /-1.07 13 [bos] arlene was perilously them up when the policeman came by . [eos] cls0 - sp0 : -13.71 -1.52 10 0.22 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp1 : -13.81 -1.53 10 0.22 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp2 : -13.87 -1.54 10 0.22 [bos] she was ! ! ; ! the ! [eos] cls0 - sp3 : -14.40 -1.60 10 0.11 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp4 : -14.49 -1.61 10 0.11 [bos] she was ! ! ; ! the ! [eos] cls1 - sp0 : -13.15 -1.46 10 0.33 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp1 : -13.33 -1.48 10 0.44 [bos] ! was ! ! ! ! the ! [eos] cls1 - sp2 : -13.45 -1.49 10 0.33 [bos] ! was ! ! ! ! the ! [eos] cls1 - sp3 : -13.48 -1.50 10 0.44 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp4 : -13.82 -1.54 10 0.44 [bos] ! was ! ! ! ! the ! [eos] cls2 - sp0 : -13.69 -1.52 10 0.56 [bos] ! was ! ! ! ! the ! [eos] cls2 - sp1 : -13.89 -1.54 10 0.67 [bos] ! : ! ! ! ! the ! [eos] cls2 - sp2 : -13.96 -1.55 10 0.56 [bos] ! : ! ! ! ! the ! [eos] cls2 - sp3 : -13.97 -1.55 10 0.56 [bos] ! was ! ! ! ! the ! [eos] cls2 - sp4 : -14.05 -1.56 10 0.56 [bos] ! : ! ! ; ! the ! [eos] cls3 - sp0 : -13.89 -1.54 10 1.00 [bos] she was ! ! ! ! the ! [eos] cls3 - sp1 : -14.02 -1.56 10 1.00 [bos] she was ! ! -- ! the ! [eos] cls3 - sp2 : -14.57 -1.62 10 1.00 [bos] don't was ! ! -- ! the ! [eos] cls3 - sp3 : -14.92 -1.66 10 1.00 [bos] 7 was ! ! -- ! the ! [eos] cls3 - sp4 : -15.00 -1.67 10 0.78 [bos] ! was ! ! ! ! the ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-345 src: none none 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt0: mod/noi/dif/loss/nce/logp -66.62 /-1.20 /-65.42 /13.12/-13.12 -5.55 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt1: mod/noi/dif/loss/nce/logp -66.62 /-1.20 /-65.42 / /-13.12 -5.55 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt2: mod/noi/dif/loss/nce/logp -86.94 /-12.88 /-74.06 / /-21.77 -7.25 /-1.07 13 [bos] arlene was boosting puts up when the policeman came by . [eos] tgt3: mod/noi/dif/loss/nce/logp -69.46 /-12.94 /-56.52 / /-4.22 -5.79 /-1.08 13 [bos] arlene was transporting them up when the policeman came by . [eos] tgt4: mod/noi/dif/loss/nce/logp -68.08 /-13.21 /-54.87 / /-2.58 -5.67 /-1.10 13 [bos] arlene was scrutinizing them up when the policeman came by . [eos] tgt5: mod/noi/dif/loss/nce/logp -65.23 /-12.84 /-52.39 / /-0.10 -5.44 /-1.07 13 [bos] arlene was perilously them up when the policeman came by . [eos] cls0 - sp0 : -13.71 -1.52 10 0.22 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp1 : -13.81 -1.53 10 0.22 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp2 : -13.87 -1.54 10 0.22 [bos] she was ! ! ; ! the ! [eos] cls0 - sp3 : -14.40 -1.60 10 0.11 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp4 : -14.49 -1.61 10 0.11 [bos] she was ! ! ; ! the ! [eos] cls1 - sp0 : -13.15 -1.46 10 0.33 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp1 : -13.33 -1.48 10 0.44 [bos] ! was ! ! ! ! the ! [eos] cls1 - sp2 : -13.45 -1.49 10 0.33 [bos] ! was ! ! ! ! the ! [eos] cls1 - sp3 : -13.48 -1.50 10 0.44 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp4 : -13.82 -1.54 10 0.44 [bos] ! was ! ! ! ! the ! [eos] cls2 - sp0 : -13.69 -1.52 10 0.56 [bos] ! was ! ! ! ! the ! [eos] cls2 - sp1 : -13.89 -1.54 10 0.67 [bos] ! : ! ! ! ! the ! [eos] cls2 - sp2 : -13.96 -1.55 10 0.56 [bos] ! : ! ! ! ! the ! [eos] cls2 - sp3 : -13.97 -1.55 10 0.56 [bos] ! was ! ! ! ! the ! [eos] cls2 - sp4 : -14.05 -1.56 10 0.56 [bos] ! : ! ! ; ! the ! [eos] cls3 - sp0 : -13.89 -1.54 10 1.00 [bos] she was ! ! ! ! the ! [eos] cls3 - sp1 : -14.02 -1.56 10 1.00 [bos] she was ! ! -- ! the ! [eos] cls3 - sp2 : -14.57 -1.62 10 1.00 [bos] don't was ! ! -- ! the ! [eos] cls3 - sp3 : -14.92 -1.66 10 1.00 [bos] 7 was ! ! -- ! the ! [eos] cls3 - sp4 : -15.00 -1.67 10 0.78 [bos] ! was ! ! ! ! the ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-346 src: none none 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt0: mod/noi/dif/loss/nce/logp -71.26 /-1.20 /-70.06 /14.57/-14.57 -5.94 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt1: mod/noi/dif/loss/nce/logp -71.26 /-1.20 /-70.06 / /-14.57 -5.94 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt2: mod/noi/dif/loss/nce/logp -88.62 /-12.88 /-75.73 / /-20.24 -7.38 /-1.07 13 [bos] arlene was boosting puts up when the policeman came by . [eos] tgt3: mod/noi/dif/loss/nce/logp -69.08 /-12.94 /-56.14 / /-0.65 -5.76 /-1.08 13 [bos] arlene was transporting them up when the policeman came by . [eos] tgt4: mod/noi/dif/loss/nce/logp -71.66 /-13.21 /-58.45 / /-2.96 -5.97 /-1.10 13 [bos] arlene was scrutinizing them up when the policeman came by . [eos] tgt5: mod/noi/dif/loss/nce/logp -69.18 /-12.84 /-56.34 / /-0.85 -5.76 /-1.07 13 [bos] arlene was perilously them up when the policeman came by . [eos] cls0 - sp0 : -15.46 -1.72 10 0.22 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp1 : -16.12 -1.79 10 0.11 [bos] she was first ! -- ! the ! [eos] cls0 - sp2 : -16.52 -1.84 10 0.11 [bos] she was joined ! -- ! the ! [eos] cls0 - sp3 : -16.59 -1.84 10 0.11 [bos] she was couldn't ! -- ! the ! [eos] cls0 - sp4 : -18.73 -1.70 12 0.18 [bos] she was first ! -- ! the ! ! ? [eos] cls1 - sp0 : -16.40 -1.82 10 0.33 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp1 : -16.42 -1.82 10 0.33 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp2 : -16.57 -1.84 10 0.44 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp3 : -17.98 -1.63 12 0.45 [bos] ! was ! ! ; ! the ! ! ! [eos] cls1 - sp4 : -17.99 -1.64 12 0.36 [bos] ! was ! ! ; ! the ! ! ! [eos] cls2 - sp0 : -18.34 -2.04 10 0.56 [bos] ! was ! ! -- ! the ! [eos] cls2 - sp1 : -19.00 -1.73 12 0.55 [bos] ! was ! ! ; ! the ! ! ! [eos] cls2 - sp2 : -19.05 -1.73 12 0.55 [bos] ! was ! ! ; ! the ! ! ! [eos] cls2 - sp3 : -19.13 -1.74 12 0.55 [bos] ! was ! ! -- ! the ! ! ! [eos] cls2 - sp4 : -19.71 -1.79 12 0.55 [bos] ! was first ! -- ! the ! ! ! [eos] cls3 - sp0 : -17.42 -1.45 13 1.00 [bos] she was don't ! and ! the ! ! by . [eos] cls3 - sp1 : -17.45 -1.45 13 1.00 [bos] she was don't later and ! the ! ! by . [eos] cls3 - sp2 : -17.73 -1.48 13 1.00 [bos] she was don't ! and ! the later ! by . [eos] cls3 - sp3 : -17.78 -1.48 13 1.00 [bos] she was don't ! and ! the personal ! by . [eos] cls3 - sp4 : -17.78 -1.48 13 1.00 [bos] she was personal later and ! the ! ! by . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-347 src: none none 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt0: mod/noi/dif/loss/nce/logp -67.63 /-1.20 /-66.43 /13.1/-13.10 -5.64 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt1: mod/noi/dif/loss/nce/logp -67.63 /-1.20 /-66.43 / /-13.10 -5.64 /-0.10 13 [bos] arlene was boosting them up when the policeman came by . [eos] tgt2: mod/noi/dif/loss/nce/logp -89.46 /-12.88 /-76.58 / /-23.25 -7.46 /-1.07 13 [bos] arlene was boosting puts up when the policeman came by . [eos] tgt3: mod/noi/dif/loss/nce/logp -69.47 /-12.94 /-56.53 / /-3.21 -5.79 /-1.08 13 [bos] arlene was transporting them up when the policeman came by . [eos] tgt4: mod/noi/dif/loss/nce/logp -69.06 /-13.21 /-55.84 / /-2.52 -5.75 /-1.10 13 [bos] arlene was scrutinizing them up when the policeman came by . [eos] tgt5: mod/noi/dif/loss/nce/logp -66.29 /-12.84 /-53.46 / /-0.13 -5.52 /-1.07 13 [bos] arlene was perilously them up when the policeman came by . [eos] cls0 - sp0 : -15.46 -1.72 10 0.22 [bos] ! was ! ! ; ! the ! [eos] cls0 - sp1 : -16.12 -1.79 10 0.11 [bos] she was first ! -- ! the ! [eos] cls0 - sp2 : -16.52 -1.84 10 0.11 [bos] she was joined ! -- ! the ! [eos] cls0 - sp3 : -16.59 -1.84 10 0.11 [bos] she was couldn't ! -- ! the ! [eos] cls0 - sp4 : -18.73 -1.70 12 0.18 [bos] she was first ! -- ! the ! ! ? [eos] cls1 - sp0 : -16.40 -1.82 10 0.33 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp1 : -16.42 -1.82 10 0.33 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp2 : -16.57 -1.84 10 0.44 [bos] ! was ! ! ; ! the ! [eos] cls1 - sp3 : -17.98 -1.63 12 0.45 [bos] ! was ! ! ; ! the ! ! ! [eos] cls1 - sp4 : -17.99 -1.64 12 0.36 [bos] ! was ! ! ; ! the ! ! ! [eos] cls2 - sp0 : -18.34 -2.04 10 0.56 [bos] ! was ! ! -- ! the ! [eos] cls2 - sp1 : -19.00 -1.73 12 0.55 [bos] ! was ! ! ; ! the ! ! ! [eos] cls2 - sp2 : -19.05 -1.73 12 0.55 [bos] ! was ! ! ; ! the ! ! ! [eos] cls2 - sp3 : -19.13 -1.74 12 0.55 [bos] ! was ! ! -- ! the ! ! ! [eos] cls2 - sp4 : -19.71 -1.79 12 0.55 [bos] ! was first ! -- ! the ! ! ! [eos] cls3 - sp0 : -17.42 -1.45 13 1.00 [bos] she was don't ! and ! the ! ! by . [eos] cls3 - sp1 : -17.45 -1.45 13 1.00 [bos] she was don't later and ! the ! ! by . [eos] cls3 - sp2 : -17.73 -1.48 13 1.00 [bos] she was don't ! and ! the later ! by . [eos] cls3 - sp3 : -17.78 -1.48 13 1.00 [bos] she was don't ! and ! the personal ! by . [eos] cls3 - sp4 : -17.78 -1.48 13 1.00 [bos] she was personal later and ! the ! ! by . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-348 src: none none 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt0: mod/noi/dif/loss/nce/logp -191.73/-4.21 /-187.52/0.69/-0.69 -4.79 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt1: mod/noi/dif/loss/nce/logp -191.73/-4.21 /-187.52/ /-0.69 -4.79 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt2: mod/noi/dif/loss/nce/logp -335.70/-12.23 /-323.47/ /-136.64 -47.96/-1.75 8 [bos] the policeman got a confused . [eos] tgt3: mod/noi/dif/loss/nce/logp -216.78/-16.10 /-200.69/ /-13.86 -5.42 /-0.40 41 [bos] the policeman got a confused , funny look on fifty face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt4: mod/noi/dif/loss/nce/logp -324.39/-13.47 /-310.92/ /-124.10 -11.59/-0.48 29 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady [eos] tgt5: mod/noi/dif/loss/nce/logp -394.79/-14.06 /-380.73/ /-193.91 -16.45/-0.59 25 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now . [eos] cls0 - sp0 : -82.44 -2.06 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( which joined and all . [eos] cls0 - sp1 : -82.66 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( there joined and all . [eos] cls0 - sp2 : -82.69 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( any joined and all . [eos] cls0 - sp3 : -82.81 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( which preceding and all . [eos] cls0 - sp4 : -82.87 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( any preceding and all . [eos] cls1 - sp0 : -101.28 -2.53 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and all . [eos] cls1 - sp1 : -102.87 -2.57 41 0.28 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and all . [eos] cls1 - sp2 : -103.06 -2.58 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and not . [eos] cls1 - sp3 : -103.24 -2.58 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and we . [eos] cls1 - sp4 : -103.58 -2.59 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and would . [eos] cls2 - sp0 : -105.10 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when all , group '' i made you so to `` which bill's and all . [eos] cls2 - sp1 : -105.11 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when thought , group '' i made you so to `` which bill's and all . [eos] cls2 - sp2 : -105.13 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when all , a : i made you so to `` which bill's and all . [eos] cls2 - sp3 : -105.13 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when thought , a : i made you so to `` which bill's and all . [eos] cls2 - sp4 : -105.14 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when all , group '' i made you so to `` which gloomy and all . [eos] cls3 - sp0 : -88.76 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first were of state , `` he , state way , a : i made you and to `` which example and all . [eos] cls3 - sp1 : -88.85 -2.22 41 1.00 [bos] [unk] almost state a state , state much on his state , and he much first were of state , `` he , much way , a : i made you and to `` which example and all . [eos] cls3 - sp2 : -88.86 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first were of state , `` he , state way , a : i made you and to `` which way and all . [eos] cls3 - sp3 : -88.86 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first were of state , `` he , state first , a : i made you and to `` which example and all . [eos] cls3 - sp4 : -88.87 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first ( of state , `` he , state way , a : i made you and to `` which example and all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-349 src: none none 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt0: mod/noi/dif/loss/nce/logp -188.73/-4.21 /-184.52/0.69/-0.69 -4.72 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt1: mod/noi/dif/loss/nce/logp -188.73/-4.21 /-184.52/ /-0.69 -4.72 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt2: mod/noi/dif/loss/nce/logp -336.04/-12.23 /-323.80/ /-139.98 -48.01/-1.75 8 [bos] the policeman got a confused . [eos] tgt3: mod/noi/dif/loss/nce/logp -214.12/-16.10 /-198.02/ /-14.19 -5.35 /-0.40 41 [bos] the policeman got a confused , funny look on fifty face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt4: mod/noi/dif/loss/nce/logp -316.77/-13.47 /-303.31/ /-119.48 -11.31/-0.48 29 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady [eos] tgt5: mod/noi/dif/loss/nce/logp -395.44/-14.06 /-381.39/ /-197.56 -16.48/-0.59 25 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now . [eos] cls0 - sp0 : -82.44 -2.06 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( which joined and all . [eos] cls0 - sp1 : -82.66 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( there joined and all . [eos] cls0 - sp2 : -82.69 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( any joined and all . [eos] cls0 - sp3 : -82.81 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( which preceding and all . [eos] cls0 - sp4 : -82.87 -2.07 41 0.03 [bos] [unk] streets but a society , `` united on his streets , and he had joined were of society , `` i , when first , a '' i joined most . is ( any preceding and all . [eos] cls1 - sp0 : -101.28 -2.53 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and all . [eos] cls1 - sp1 : -102.87 -2.57 41 0.28 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and all . [eos] cls1 - sp2 : -103.06 -2.58 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and not . [eos] cls1 - sp3 : -103.24 -2.58 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and we . [eos] cls1 - sp4 : -103.58 -2.59 41 0.25 [bos] '' dr. so a cleaning , -- your on his streets , and he had preceding were of recalled , `` i , when first , a '' i made you other to ( which joined and would . [eos] cls2 - sp0 : -105.10 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when all , group '' i made you so to `` which bill's and all . [eos] cls2 - sp1 : -105.11 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when thought , group '' i made you so to `` which bill's and all . [eos] cls2 - sp2 : -105.13 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when all , a : i made you so to `` which bill's and all . [eos] cls2 - sp3 : -105.13 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when thought , a : i made you so to `` which bill's and all . [eos] cls2 - sp4 : -105.14 -2.63 41 0.73 [bos] [unk] streets when a crime , -- were on his state , and he had agree were of state , `` but , when all , group '' i made you so to `` which gloomy and all . [eos] cls3 - sp0 : -88.76 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first were of state , `` he , state way , a : i made you and to `` which example and all . [eos] cls3 - sp1 : -88.85 -2.22 41 1.00 [bos] [unk] almost state a state , state much on his state , and he much first were of state , `` he , much way , a : i made you and to `` which example and all . [eos] cls3 - sp2 : -88.86 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first were of state , `` he , state way , a : i made you and to `` which way and all . [eos] cls3 - sp3 : -88.86 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first were of state , `` he , state first , a : i made you and to `` which example and all . [eos] cls3 - sp4 : -88.87 -2.22 41 1.00 [bos] in almost state a state , state much on his state , and he much first ( of state , `` he , state way , a : i made you and to `` which example and all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-350 src: none none 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt0: mod/noi/dif/loss/nce/logp -185.57/-4.21 /-181.35/0.69/-0.69 -4.64 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt1: mod/noi/dif/loss/nce/logp -185.57/-4.21 /-181.35/ /-0.69 -4.64 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt2: mod/noi/dif/loss/nce/logp -332.99/-12.23 /-320.76/ /-140.10 -47.57/-1.75 8 [bos] the policeman got a confused . [eos] tgt3: mod/noi/dif/loss/nce/logp -209.63/-16.10 /-193.53/ /-12.88 -5.24 /-0.40 41 [bos] the policeman got a confused , funny look on fifty face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt4: mod/noi/dif/loss/nce/logp -327.85/-13.47 /-314.38/ /-133.73 -11.71/-0.48 29 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady [eos] tgt5: mod/noi/dif/loss/nce/logp -387.02/-14.06 /-372.97/ /-192.31 -16.13/-0.59 25 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now . [eos] cls0 - sp0 : -80.48 -2.01 41 0.03 [bos] was streets were a honeymoon , and streets on his united , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp1 : -80.49 -2.01 41 0.03 [bos] was streets were a expecting , and streets on his has , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp2 : -80.50 -2.01 41 0.03 [bos] was streets were a expecting , and streets on his united , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp3 : -80.51 -2.01 41 0.03 [bos] was streets were a expecting , once ) on his united , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp4 : -80.56 -2.01 41 0.03 [bos] was streets were a expecting , once ) on his has , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls1 - sp0 : -100.44 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , landed '' i any you and to ( any preceding and all . [eos] cls1 - sp1 : -100.47 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , landed '' i any you and to ( there preceding and all . [eos] cls1 - sp2 : -100.53 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , puny '' i any you and to ( any preceding and all . [eos] cls1 - sp3 : -100.55 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had society were of streets , `` were , it all , landed '' i any you and to ( any preceding and all . [eos] cls1 - sp4 : -100.56 -2.51 41 0.28 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , landed '' i any you and to ( any preceding and all . [eos] cls2 - sp0 : -101.84 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` her , it all , crime to i about you names to new space gloomy and all . [eos] cls2 - sp1 : -101.87 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` her , it all , crime to i about you names to new over gloomy and all . [eos] cls2 - sp2 : -101.90 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` were , it all , crime to i about you names to new space gloomy and all . [eos] cls2 - sp3 : -101.92 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` were , it all , crime to i about you names to new over gloomy and all . [eos] cls2 - sp4 : -101.96 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` her , it all , crime to i about you names to new these gloomy and all . [eos] cls3 - sp0 : -86.54 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had state were of streets , `` who , it way , crime to i about you and to new these example and all . [eos] cls3 - sp1 : -86.55 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had crime were of streets , `` who , it way , crime to i about you and to new these example and all . [eos] cls3 - sp2 : -86.56 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had crime were of streets , `` who , it way , crime to i about you and to new over example and all . [eos] cls3 - sp3 : -86.56 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had state were of streets , `` who , it way , crime to i about you and to new over example and all . [eos] cls3 - sp4 : -86.66 -2.17 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had state were of streets , `` who , it way , crime to i about you and to new these crime and all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-351 src: none none 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt0: mod/noi/dif/loss/nce/logp -184.36/-4.21 /-180.15/0.69/-0.69 -4.61 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt1: mod/noi/dif/loss/nce/logp -184.36/-4.21 /-180.15/ /-0.69 -4.61 /-0.11 41 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt2: mod/noi/dif/loss/nce/logp -333.02/-12.23 /-320.78/ /-141.33 -47.57/-1.75 8 [bos] the policeman got a confused . [eos] tgt3: mod/noi/dif/loss/nce/logp -208.78/-16.10 /-192.69/ /-13.23 -5.22 /-0.40 41 [bos] the policeman got a confused , funny look on fifty face , and he had answered kind of politely , `` now , look here , lady : i know you got to entertain these kids and all . [eos] tgt4: mod/noi/dif/loss/nce/logp -326.52/-13.47 /-313.05/ /-133.59 -11.66/-0.48 29 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now , look here , lady [eos] tgt5: mod/noi/dif/loss/nce/logp -389.52/-14.06 /-375.46/ /-196.00 -16.23/-0.59 25 [bos] the policeman got a confused , funny look on his face , and he had answered kind of politely , `` now . [eos] cls0 - sp0 : -80.48 -2.01 41 0.03 [bos] was streets were a honeymoon , and streets on his united , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp1 : -80.49 -2.01 41 0.03 [bos] was streets were a expecting , and streets on his has , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp2 : -80.50 -2.01 41 0.03 [bos] was streets were a expecting , and streets on his united , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp3 : -80.51 -2.01 41 0.03 [bos] was streets were a expecting , once ) on his united , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls0 - sp4 : -80.56 -2.01 41 0.03 [bos] was streets were a expecting , once ) on his has , and he had society were of streets , `` other , it all , preceding '' i any you . is own there preceding and all . [eos] cls1 - sp0 : -100.44 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , landed '' i any you and to ( any preceding and all . [eos] cls1 - sp1 : -100.47 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , landed '' i any you and to ( there preceding and all . [eos] cls1 - sp2 : -100.53 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , puny '' i any you and to ( any preceding and all . [eos] cls1 - sp3 : -100.55 -2.51 41 0.25 [bos] was streets american a minds , and almost on his united , and he had society were of streets , `` were , it all , landed '' i any you and to ( any preceding and all . [eos] cls1 - sp4 : -100.56 -2.51 41 0.28 [bos] was streets american a minds , and almost on his united , and he had governor's were of streets , `` were , it all , landed '' i any you and to ( any preceding and all . [eos] cls2 - sp0 : -101.84 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` her , it all , crime to i about you names to new space gloomy and all . [eos] cls2 - sp1 : -101.87 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` her , it all , crime to i about you names to new over gloomy and all . [eos] cls2 - sp2 : -101.90 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` were , it all , crime to i about you names to new space gloomy and all . [eos] cls2 - sp3 : -101.92 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` were , it all , crime to i about you names to new over gloomy and all . [eos] cls2 - sp4 : -101.96 -2.55 41 0.73 [bos] was states were a streets , -- ( on his state , and he had cleaning were of streets , `` her , it all , crime to i about you names to new these gloomy and all . [eos] cls3 - sp0 : -86.54 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had state were of streets , `` who , it way , crime to i about you and to new these example and all . [eos] cls3 - sp1 : -86.55 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had crime were of streets , `` who , it way , crime to i about you and to new these example and all . [eos] cls3 - sp2 : -86.56 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had crime were of streets , `` who , it way , crime to i about you and to new over example and all . [eos] cls3 - sp3 : -86.56 -2.16 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had state were of streets , `` who , it way , crime to i about you and to new over example and all . [eos] cls3 - sp4 : -86.66 -2.17 41 1.00 [bos] in almost state a streets , -- ( on his state , and he had state were of streets , `` who , it way , crime to i about you and to new these crime and all . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-352 src: none none 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt0: mod/noi/dif/loss/nce/logp -106.58/-2.34 /-104.25/0.69/-0.69 -4.63 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt1: mod/noi/dif/loss/nce/logp -106.58/-2.34 /-104.25/ /-0.69 -4.63 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt2: mod/noi/dif/loss/nce/logp -128.23/-12.74 /-115.49/ /-11.94 -5.58 /-0.55 24 [bos] they both tried to keep smiling and winking for a long time , but it made the lips and eyelids tremble . [eos] tgt3: mod/noi/dif/loss/nce/logp -337.03/-12.86 /-324.17/ /-220.62 -24.07/-0.92 15 [bos] they both tried to keep smiling and winking for a long time . [eos] tgt4: mod/noi/dif/loss/nce/logp -127.25/-13.06 /-114.19/ /-10.63 -5.53 /-0.57 24 [bos] they both tried to keep smiling and winking , a long time , but it made their lips and eyelids tremble . [eos] tgt5: mod/noi/dif/loss/nce/logp -233.76/-11.77 /-221.99/ /-118.44 -58.44/-2.94 5 [bos] they both tried [eos] cls0 - sp0 : -48.28 -2.10 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and expecting joined . [eos] cls0 - sp1 : -48.32 -2.10 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and landed joined . [eos] cls0 - sp2 : -48.43 -2.11 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and patience joined . [eos] cls0 - sp3 : -48.47 -2.11 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and cleaning joined . [eos] cls0 - sp4 : -48.50 -2.11 24 0.04 [bos] ! ( joined to i joined and joined for a later by , but it made their ! and landed joined . [eos] cls1 - sp0 : -60.31 -2.62 24 0.26 [bos] ! ! later to i cleaning and joined for a later by , but it made their ! and bidding ! . [eos] cls1 - sp1 : -60.32 -2.62 24 0.26 [bos] ! ! later to i cleaning and cleaning for a later by , but it made their ! and bidding ! . [eos] cls1 - sp2 : -60.33 -2.62 24 0.26 [bos] ! ! later to i cleaning and joined for a later by , but it made their ! and bidding ! . [eos] cls1 - sp3 : -60.33 -2.62 24 0.26 [bos] ! ! later to i cleaning and cleaning for a later by , but it made their ! and bidding ! . [eos] cls1 - sp4 : -60.34 -2.62 24 0.26 [bos] ! ! later to i cleaning and joined for a later by , but it made their ! and skies ! . [eos] cls2 - sp0 : -60.61 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and wiped telephone . [eos] cls2 - sp1 : -60.62 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and ferraros telephone . [eos] cls2 - sp2 : -60.72 -2.64 24 0.74 [bos] ! ! later to all telephone and laughed for a personal by , but it made their ! and ferraros telephone . [eos] cls2 - sp3 : -60.78 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and middle-aged ! . [eos] cls2 - sp4 : -60.78 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and bidding telephone . [eos] cls3 - sp0 : -48.54 -2.11 24 0.96 [bos] ! ! later to all telephone and reliable for a personal on , but it made their this and telephone telephone . [eos] cls3 - sp1 : -48.55 -2.11 24 1.00 [bos] ! property later to all telephone and personal for a personal on , but it made their this and telephone telephone . [eos] cls3 - sp2 : -48.59 -2.11 24 0.96 [bos] ! ! later to all telephone and telephone for a personal on , but it made their their and telephone telephone . [eos] cls3 - sp3 : -48.61 -2.11 24 0.96 [bos] ! ! later to all telephone and telephone for a personal on , but it made their this and telephone telephone . [eos] cls3 - sp4 : -48.61 -2.11 24 0.96 [bos] ! ! later to all telephone and personal for a personal on , but it made their this and telephone telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-353 src: none none 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt0: mod/noi/dif/loss/nce/logp -103.05/-2.34 /-100.71/0.69/-0.69 -4.48 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt1: mod/noi/dif/loss/nce/logp -103.05/-2.34 /-100.71/ /-0.69 -4.48 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt2: mod/noi/dif/loss/nce/logp -126.08/-12.74 /-113.34/ /-13.32 -5.48 /-0.55 24 [bos] they both tried to keep smiling and winking for a long time , but it made the lips and eyelids tremble . [eos] tgt3: mod/noi/dif/loss/nce/logp -318.76/-12.86 /-305.90/ /-205.88 -22.77/-0.92 15 [bos] they both tried to keep smiling and winking for a long time . [eos] tgt4: mod/noi/dif/loss/nce/logp -123.46/-13.06 /-110.40/ /-10.38 -5.37 /-0.57 24 [bos] they both tried to keep smiling and winking , a long time , but it made their lips and eyelids tremble . [eos] tgt5: mod/noi/dif/loss/nce/logp -232.04/-11.77 /-220.27/ /-120.25 -58.01/-2.94 5 [bos] they both tried [eos] cls0 - sp0 : -48.28 -2.10 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and expecting joined . [eos] cls0 - sp1 : -48.32 -2.10 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and landed joined . [eos] cls0 - sp2 : -48.43 -2.11 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and patience joined . [eos] cls0 - sp3 : -48.47 -2.11 24 0.04 [bos] ! ( later to i joined and joined for a later by , but it made their ! and cleaning joined . [eos] cls0 - sp4 : -48.50 -2.11 24 0.04 [bos] ! ( joined to i joined and joined for a later by , but it made their ! and landed joined . [eos] cls1 - sp0 : -60.31 -2.62 24 0.26 [bos] ! ! later to i cleaning and joined for a later by , but it made their ! and bidding ! . [eos] cls1 - sp1 : -60.32 -2.62 24 0.26 [bos] ! ! later to i cleaning and cleaning for a later by , but it made their ! and bidding ! . [eos] cls1 - sp2 : -60.33 -2.62 24 0.26 [bos] ! ! later to i cleaning and joined for a later by , but it made their ! and bidding ! . [eos] cls1 - sp3 : -60.33 -2.62 24 0.26 [bos] ! ! later to i cleaning and cleaning for a later by , but it made their ! and bidding ! . [eos] cls1 - sp4 : -60.34 -2.62 24 0.26 [bos] ! ! later to i cleaning and joined for a later by , but it made their ! and skies ! . [eos] cls2 - sp0 : -60.61 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and wiped telephone . [eos] cls2 - sp1 : -60.62 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and ferraros telephone . [eos] cls2 - sp2 : -60.72 -2.64 24 0.74 [bos] ! ! later to all telephone and laughed for a personal by , but it made their ! and ferraros telephone . [eos] cls2 - sp3 : -60.78 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and middle-aged ! . [eos] cls2 - sp4 : -60.78 -2.64 24 0.74 [bos] ! ! later to all corner and laughed for a personal by , but it made their ! and bidding telephone . [eos] cls3 - sp0 : -48.54 -2.11 24 0.96 [bos] ! ! later to all telephone and reliable for a personal on , but it made their this and telephone telephone . [eos] cls3 - sp1 : -48.55 -2.11 24 1.00 [bos] ! property later to all telephone and personal for a personal on , but it made their this and telephone telephone . [eos] cls3 - sp2 : -48.59 -2.11 24 0.96 [bos] ! ! later to all telephone and telephone for a personal on , but it made their their and telephone telephone . [eos] cls3 - sp3 : -48.61 -2.11 24 0.96 [bos] ! ! later to all telephone and telephone for a personal on , but it made their this and telephone telephone . [eos] cls3 - sp4 : -48.61 -2.11 24 0.96 [bos] ! ! later to all telephone and personal for a personal on , but it made their this and telephone telephone . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-354 src: none none 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt0: mod/noi/dif/loss/nce/logp -110.61/-2.34 /-108.27/0.69/-0.69 -4.81 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt1: mod/noi/dif/loss/nce/logp -110.61/-2.34 /-108.27/ /-0.69 -4.81 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt2: mod/noi/dif/loss/nce/logp -132.43/-12.74 /-119.69/ /-12.11 -5.76 /-0.55 24 [bos] they both tried to keep smiling and winking for a long time , but it made the lips and eyelids tremble . [eos] tgt3: mod/noi/dif/loss/nce/logp -334.00/-12.86 /-321.14/ /-213.56 -23.86/-0.92 15 [bos] they both tried to keep smiling and winking for a long time . [eos] tgt4: mod/noi/dif/loss/nce/logp -129.09/-13.06 /-116.03/ /-8.46 -5.61 /-0.57 24 [bos] they both tried to keep smiling and winking , a long time , but it made their lips and eyelids tremble . [eos] tgt5: mod/noi/dif/loss/nce/logp -231.27/-11.77 /-219.51/ /-111.93 -57.82/-2.94 5 [bos] they both tried [eos] cls0 - sp0 : -49.72 -2.16 24 0.00 [bos] i an first to made joined and joined for a any there , but it made their sake and cleaning joined . [eos] cls0 - sp1 : -49.80 -2.17 24 0.00 [bos] i property first to made joined and joined for a any there , but it made their sake and cleaning joined . [eos] cls0 - sp2 : -49.80 -2.17 24 0.00 [bos] i an first to made joined and joined for a later there , but it made their sake and cleaning joined . [eos] cls0 - sp3 : -49.81 -2.17 24 0.00 [bos] i an first to made joined and joined for a later there , but it made their landed and cleaning joined . [eos] cls0 - sp4 : -49.81 -2.17 24 0.00 [bos] i property first to made joined and joined for a any there , but it made their landed and cleaning joined . [eos] cls1 - sp0 : -37.90 -2.11 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a later on , but it made their [eos] cls1 - sp1 : -38.22 -2.12 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a later all , but it made their [eos] cls1 - sp2 : -38.34 -2.13 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a couldn't on , but it made their [eos] cls1 - sp3 : -38.61 -2.15 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a any all , but it made their [eos] cls1 - sp4 : -38.62 -2.15 19 0.33 [bos] ! ! couldn't to made corner and joined for a later on , but it made their [eos] cls2 - sp0 : -41.31 -2.29 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a any space , but it made their [eos] cls2 - sp1 : -41.49 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a any by , but it made their [eos] cls2 - sp2 : -41.53 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a any on , but it made their [eos] cls2 - sp3 : -41.55 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a later space , but it made their [eos] cls2 - sp4 : -41.63 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a later on , but it made their [eos] cls3 - sp0 : -48.50 -2.11 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and telephone crime . [eos] cls3 - sp1 : -48.63 -2.11 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and mississippi state . [eos] cls3 - sp2 : -48.67 -2.12 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and mississippi crime . [eos] cls3 - sp3 : -48.67 -2.12 24 1.00 [bos] don't -- don't to made personal and telephone for a later on , but it made their telephone and telephone crime . [eos] cls3 - sp4 : -48.67 -2.12 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and telephone state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-355 src: none none 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt0: mod/noi/dif/loss/nce/logp -103.95/-2.34 /-101.62/0.69/-0.69 -4.52 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt1: mod/noi/dif/loss/nce/logp -103.95/-2.34 /-101.62/ /-0.69 -4.52 /-0.10 24 [bos] they both tried to keep smiling and winking for a long time , but it made their lips and eyelids tremble . [eos] tgt2: mod/noi/dif/loss/nce/logp -127.42/-12.74 /-114.68/ /-13.76 -5.54 /-0.55 24 [bos] they both tried to keep smiling and winking for a long time , but it made the lips and eyelids tremble . [eos] tgt3: mod/noi/dif/loss/nce/logp -299.31/-12.86 /-286.45/ /-185.53 -21.38/-0.92 15 [bos] they both tried to keep smiling and winking for a long time . [eos] tgt4: mod/noi/dif/loss/nce/logp -121.89/-13.06 /-108.83/ /-7.91 -5.30 /-0.57 24 [bos] they both tried to keep smiling and winking , a long time , but it made their lips and eyelids tremble . [eos] tgt5: mod/noi/dif/loss/nce/logp -230.21/-11.77 /-218.45/ /-117.52 -57.55/-2.94 5 [bos] they both tried [eos] cls0 - sp0 : -49.72 -2.16 24 0.00 [bos] i an first to made joined and joined for a any there , but it made their sake and cleaning joined . [eos] cls0 - sp1 : -49.80 -2.17 24 0.00 [bos] i property first to made joined and joined for a any there , but it made their sake and cleaning joined . [eos] cls0 - sp2 : -49.80 -2.17 24 0.00 [bos] i an first to made joined and joined for a later there , but it made their sake and cleaning joined . [eos] cls0 - sp3 : -49.81 -2.17 24 0.00 [bos] i an first to made joined and joined for a later there , but it made their landed and cleaning joined . [eos] cls0 - sp4 : -49.81 -2.17 24 0.00 [bos] i property first to made joined and joined for a any there , but it made their landed and cleaning joined . [eos] cls1 - sp0 : -37.90 -2.11 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a later on , but it made their [eos] cls1 - sp1 : -38.22 -2.12 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a later all , but it made their [eos] cls1 - sp2 : -38.34 -2.13 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a couldn't on , but it made their [eos] cls1 - sp3 : -38.61 -2.15 19 0.33 [bos] ! ! couldn't to made corner and couldn't for a any all , but it made their [eos] cls1 - sp4 : -38.62 -2.15 19 0.33 [bos] ! ! couldn't to made corner and joined for a later on , but it made their [eos] cls2 - sp0 : -41.31 -2.29 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a any space , but it made their [eos] cls2 - sp1 : -41.49 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a any by , but it made their [eos] cls2 - sp2 : -41.53 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a any on , but it made their [eos] cls2 - sp3 : -41.55 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a later space , but it made their [eos] cls2 - sp4 : -41.63 -2.31 19 0.50 [bos] ! ! couldn't to made corner and couldn't for a later on , but it made their [eos] cls3 - sp0 : -48.50 -2.11 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and telephone crime . [eos] cls3 - sp1 : -48.63 -2.11 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and mississippi state . [eos] cls3 - sp2 : -48.67 -2.12 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and mississippi crime . [eos] cls3 - sp3 : -48.67 -2.12 24 1.00 [bos] don't -- don't to made personal and telephone for a later on , but it made their telephone and telephone crime . [eos] cls3 - sp4 : -48.67 -2.12 24 1.00 [bos] don't -- don't to made personal and corner for a later on , but it made their telephone and telephone state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-356 src: none none 13 [bos] the first one said , `` he sure does shake . [eos] tgt0: mod/noi/dif/loss/nce/logp -55.07 /-1.35 /-53.72 /0.72/-0.72 -4.59 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt1: mod/noi/dif/loss/nce/logp -55.07 /-1.35 /-53.72 / /-0.72 -4.59 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.06 /-12.39 /-72.67 / /-19.67 -7.73 /-1.13 12 [bos] the first one said , `` he sure does shake [eos] tgt3: mod/noi/dif/loss/nce/logp -94.29 /-12.49 /-81.80 / /-28.80 -7.25 /-0.96 14 [bos] the first one said , `` he sure does shake . . [eos] tgt4: mod/noi/dif/loss/nce/logp -76.47 /-12.36 /-64.11 / /-11.11 -6.37 /-1.03 13 [bos] the first one said , a he sure does shake . [eos] tgt5: mod/noi/dif/loss/nce/logp -69.58 /-12.80 /-56.78 / /-3.78 -5.80 /-1.07 13 [bos] a first one said , `` he sure does shake . [eos] cls0 - sp0 : -17.45 -1.75 11 0.20 [bos] : ! ; ! , `` ! ! ! [eos] cls0 - sp1 : -18.27 -1.83 11 0.20 [bos] : all ; ! , `` ! ! ! [eos] cls0 - sp2 : -18.39 -1.84 11 0.10 [bos] : ! ; ! , `` i ! ! [eos] cls0 - sp3 : -18.45 -1.84 11 0.20 [bos] : ! ; ! , `` i ! ! [eos] cls0 - sp4 : -18.46 -1.85 11 0.20 [bos] : ! ; ! , `` he ! ! [eos] cls1 - sp0 : -18.13 -1.81 11 0.30 [bos] : ! ; ! , `` ! ! ! [eos] cls1 - sp1 : -18.30 -1.83 11 0.30 [bos] : ! ; ! , `` ! ! ! [eos] cls1 - sp2 : -18.41 -1.84 11 0.40 [bos] : ! ; ! , `` ! ! ! [eos] cls1 - sp3 : -19.60 -1.96 11 0.30 [bos] : all ; ! , `` ! ! ! [eos] cls1 - sp4 : -19.65 -1.97 11 0.30 [bos] : ! ; ! , `` he ! ! [eos] cls2 - sp0 : -19.63 -1.96 11 0.50 [bos] : ! ; ! , `` ! ! ! [eos] cls2 - sp1 : -23.02 -2.09 12 0.55 [bos] : ! ; ! , `` ! ! ! ! [eos] cls2 - sp2 : -23.05 -1.92 13 0.67 [bos] she all ; ! , `` i ! ! ! ! [eos] cls2 - sp3 : -23.16 -1.93 13 0.58 [bos] she all ; ! , `` i ! ! ! ! [eos] cls2 - sp4 : -23.21 -1.93 13 0.67 [bos] she all ; ! , `` he ! ! ! ! [eos] cls3 - sp0 : -22.45 -1.87 13 0.92 [bos] she all ; had , `` he corner later made . [eos] cls3 - sp1 : -22.46 -1.87 13 0.92 [bos] she all ; had , `` he personal later made . [eos] cls3 - sp2 : -22.49 -2.04 12 0.91 [bos] she all ; had , `` he personal life . [eos] cls3 - sp3 : -22.59 -1.88 13 0.92 [bos] she all ; had , `` he personal life made . [eos] cls3 - sp4 : -22.70 -1.89 13 0.92 [bos] she all ; had , `` he telephone later made . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-357 src: none none 13 [bos] the first one said , `` he sure does shake . [eos] tgt0: mod/noi/dif/loss/nce/logp -57.23 /-1.35 /-55.88 /0.77/-0.77 -4.77 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt1: mod/noi/dif/loss/nce/logp -57.23 /-1.35 /-55.88 / /-0.77 -4.77 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt2: mod/noi/dif/loss/nce/logp -92.43 /-12.39 /-80.04 / /-24.92 -8.40 /-1.13 12 [bos] the first one said , `` he sure does shake [eos] tgt3: mod/noi/dif/loss/nce/logp -95.98 /-12.49 /-83.49 / /-28.38 -7.38 /-0.96 14 [bos] the first one said , `` he sure does shake . . [eos] tgt4: mod/noi/dif/loss/nce/logp -78.61 /-12.36 /-66.26 / /-11.14 -6.55 /-1.03 13 [bos] the first one said , a he sure does shake . [eos] tgt5: mod/noi/dif/loss/nce/logp -70.57 /-12.80 /-57.77 / /-2.66 -5.88 /-1.07 13 [bos] a first one said , `` he sure does shake . [eos] cls0 - sp0 : -17.45 -1.75 11 0.20 [bos] : ! ; ! , `` ! ! ! [eos] cls0 - sp1 : -18.27 -1.83 11 0.20 [bos] : all ; ! , `` ! ! ! [eos] cls0 - sp2 : -18.39 -1.84 11 0.10 [bos] : ! ; ! , `` i ! ! [eos] cls0 - sp3 : -18.45 -1.84 11 0.20 [bos] : ! ; ! , `` i ! ! [eos] cls0 - sp4 : -18.46 -1.85 11 0.20 [bos] : ! ; ! , `` he ! ! [eos] cls1 - sp0 : -18.13 -1.81 11 0.30 [bos] : ! ; ! , `` ! ! ! [eos] cls1 - sp1 : -18.30 -1.83 11 0.30 [bos] : ! ; ! , `` ! ! ! [eos] cls1 - sp2 : -18.41 -1.84 11 0.40 [bos] : ! ; ! , `` ! ! ! [eos] cls1 - sp3 : -19.60 -1.96 11 0.30 [bos] : all ; ! , `` ! ! ! [eos] cls1 - sp4 : -19.65 -1.97 11 0.30 [bos] : ! ; ! , `` he ! ! [eos] cls2 - sp0 : -19.63 -1.96 11 0.50 [bos] : ! ; ! , `` ! ! ! [eos] cls2 - sp1 : -23.02 -2.09 12 0.55 [bos] : ! ; ! , `` ! ! ! ! [eos] cls2 - sp2 : -23.05 -1.92 13 0.67 [bos] she all ; ! , `` i ! ! ! ! [eos] cls2 - sp3 : -23.16 -1.93 13 0.58 [bos] she all ; ! , `` i ! ! ! ! [eos] cls2 - sp4 : -23.21 -1.93 13 0.67 [bos] she all ; ! , `` he ! ! ! ! [eos] cls3 - sp0 : -22.45 -1.87 13 0.92 [bos] she all ; had , `` he corner later made . [eos] cls3 - sp1 : -22.46 -1.87 13 0.92 [bos] she all ; had , `` he personal later made . [eos] cls3 - sp2 : -22.49 -2.04 12 0.91 [bos] she all ; had , `` he personal life . [eos] cls3 - sp3 : -22.59 -1.88 13 0.92 [bos] she all ; had , `` he personal life made . [eos] cls3 - sp4 : -22.70 -1.89 13 0.92 [bos] she all ; had , `` he telephone later made . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-358 src: none none 13 [bos] the first one said , `` he sure does shake . [eos] tgt0: mod/noi/dif/loss/nce/logp -54.64 /-1.35 /-53.29 /0.7/-0.70 -4.55 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt1: mod/noi/dif/loss/nce/logp -54.64 /-1.35 /-53.29 / /-0.70 -4.55 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt2: mod/noi/dif/loss/nce/logp -83.78 /-12.39 /-71.39 / /-18.80 -7.62 /-1.13 12 [bos] the first one said , `` he sure does shake [eos] tgt3: mod/noi/dif/loss/nce/logp -92.65 /-12.49 /-80.16 / /-27.57 -7.13 /-0.96 14 [bos] the first one said , `` he sure does shake . . [eos] tgt4: mod/noi/dif/loss/nce/logp -74.62 /-12.36 /-62.26 / /-9.67 -6.22 /-1.03 13 [bos] the first one said , a he sure does shake . [eos] tgt5: mod/noi/dif/loss/nce/logp -70.11 /-12.80 /-57.32 / /-4.73 -5.84 /-1.07 13 [bos] a first one said , `` he sure does shake . [eos] cls0 - sp0 : -22.21 -2.22 11 0.00 [bos] she all ; had , when he any ! [eos] cls0 - sp1 : -22.50 -2.25 11 0.10 [bos] she all ; had , when he any ! [eos] cls0 - sp2 : -22.52 -1.88 13 0.00 [bos] she all ; had , when he any ! ! . [eos] cls0 - sp3 : -22.85 -1.90 13 0.00 [bos] she all ; had , `` he any ! ! . [eos] cls0 - sp4 : -22.86 -1.90 13 0.00 [bos] she all one had , when he any ! ! . [eos] cls1 - sp0 : -18.71 -1.87 11 0.30 [bos] : ! ; ! , when he any ! [eos] cls1 - sp1 : -19.16 -1.92 11 0.30 [bos] : ! ; ! , `` he any ! [eos] cls1 - sp2 : -19.31 -1.93 11 0.30 [bos] : ! ; ! , `` he no ! [eos] cls1 - sp3 : -19.36 -1.94 11 0.30 [bos] : ! ; ! , when he no ! [eos] cls1 - sp4 : -19.48 -1.95 11 0.30 [bos] : ! ; ! , when he take ! [eos] cls2 - sp0 : -17.69 -1.77 11 0.70 [bos] she ! ; ! , `` he ! ! [eos] cls2 - sp1 : -17.81 -1.78 11 0.70 [bos] she ! ; ! , `` he ! ! [eos] cls2 - sp2 : -18.14 -1.81 11 0.70 [bos] she ! ; ! , `` when ! ! [eos] cls2 - sp3 : -18.28 -1.83 11 0.70 [bos] she ! ; ) , `` he ! ! [eos] cls2 - sp4 : -18.45 -1.85 11 0.60 [bos] she ! ; ! , `` he ! ! [eos] cls3 - sp0 : -17.95 -1.80 11 0.90 [bos] she ! ; ! , `` he later ! [eos] cls3 - sp1 : -18.51 -1.85 11 0.80 [bos] she ! ; ! , `` he later ! [eos] cls3 - sp2 : -19.07 -1.91 11 0.80 [bos] she ! ; ! , `` he no ! [eos] cls3 - sp3 : -19.15 -1.92 11 0.90 [bos] she ! ; ! , `` he no ! [eos] cls3 - sp4 : -19.44 -1.94 11 0.80 [bos] she ! ; ) , `` he later ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-359 src: none none 13 [bos] the first one said , `` he sure does shake . [eos] tgt0: mod/noi/dif/loss/nce/logp -58.04 /-1.35 /-56.69 /0.73/-0.73 -4.84 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt1: mod/noi/dif/loss/nce/logp -58.04 /-1.35 /-56.69 / /-0.73 -4.84 /-0.11 13 [bos] the first one said , `` he sure does shake . [eos] tgt2: mod/noi/dif/loss/nce/logp -91.39 /-12.39 /-79.00 / /-23.03 -8.31 /-1.13 12 [bos] the first one said , `` he sure does shake [eos] tgt3: mod/noi/dif/loss/nce/logp -95.90 /-12.49 /-83.41 / /-27.45 -7.38 /-0.96 14 [bos] the first one said , `` he sure does shake . . [eos] tgt4: mod/noi/dif/loss/nce/logp -77.87 /-12.36 /-65.51 / /-9.54 -6.49 /-1.03 13 [bos] the first one said , a he sure does shake . [eos] tgt5: mod/noi/dif/loss/nce/logp -72.18 /-12.80 /-59.38 / /-3.42 -6.02 /-1.07 13 [bos] a first one said , `` he sure does shake . [eos] cls0 - sp0 : -22.21 -2.22 11 0.00 [bos] she all ; had , when he any ! [eos] cls0 - sp1 : -22.50 -2.25 11 0.10 [bos] she all ; had , when he any ! [eos] cls0 - sp2 : -22.52 -1.88 13 0.00 [bos] she all ; had , when he any ! ! . [eos] cls0 - sp3 : -22.85 -1.90 13 0.00 [bos] she all ; had , `` he any ! ! . [eos] cls0 - sp4 : -22.86 -1.90 13 0.00 [bos] she all one had , when he any ! ! . [eos] cls1 - sp0 : -18.71 -1.87 11 0.30 [bos] : ! ; ! , when he any ! [eos] cls1 - sp1 : -19.16 -1.92 11 0.30 [bos] : ! ; ! , `` he any ! [eos] cls1 - sp2 : -19.31 -1.93 11 0.30 [bos] : ! ; ! , `` he no ! [eos] cls1 - sp3 : -19.36 -1.94 11 0.30 [bos] : ! ; ! , when he no ! [eos] cls1 - sp4 : -19.48 -1.95 11 0.30 [bos] : ! ; ! , when he take ! [eos] cls2 - sp0 : -17.69 -1.77 11 0.70 [bos] she ! ; ! , `` he ! ! [eos] cls2 - sp1 : -17.81 -1.78 11 0.70 [bos] she ! ; ! , `` he ! ! [eos] cls2 - sp2 : -18.14 -1.81 11 0.70 [bos] she ! ; ! , `` when ! ! [eos] cls2 - sp3 : -18.28 -1.83 11 0.70 [bos] she ! ; ) , `` he ! ! [eos] cls2 - sp4 : -18.45 -1.85 11 0.60 [bos] she ! ; ! , `` he ! ! [eos] cls3 - sp0 : -17.95 -1.80 11 0.90 [bos] she ! ; ! , `` he later ! [eos] cls3 - sp1 : -18.51 -1.85 11 0.80 [bos] she ! ; ! , `` he later ! [eos] cls3 - sp2 : -19.07 -1.91 11 0.80 [bos] she ! ; ! , `` he no ! [eos] cls3 - sp3 : -19.15 -1.92 11 0.90 [bos] she ! ; ! , `` he no ! [eos] cls3 - sp4 : -19.44 -1.94 11 0.80 [bos] she ! ; ) , `` he later ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-360 src: none none 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt0: mod/noi/dif/loss/nce/logp -86.48 /-1.74 /-84.74 /0.69/-0.69 -5.09 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt1: mod/noi/dif/loss/nce/logp -86.48 /-1.74 /-84.74 / /-0.69 -5.09 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt2: mod/noi/dif/loss/nce/logp -296.63/-11.56 /-285.07/ /-201.02 -37.08/-1.45 9 [bos] `` it's perfectly understandable , arlene . [eos] tgt3: mod/noi/dif/loss/nce/logp -123.72/-12.71 /-111.01/ /-26.97 -7.73 /-0.79 17 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way [eos] tgt4: mod/noi/dif/loss/nce/logp -224.11/-12.08 /-212.03/ /-127.98 -32.02/-1.73 8 [bos] `` it's perfectly understandable , arlene [eos] tgt5: mod/noi/dif/loss/nce/logp -208.79/-12.29 /-196.50/ /-112.45 -23.20/-1.37 10 [bos] `` it's perfectly understandable , arlene '' . [eos] cls0 - sp0 : -24.23 -2.20 12 0.09 [bos] `` she first cleaning , streets '' , ! ! [eos] cls0 - sp1 : -25.24 -2.29 12 0.09 [bos] `` she first cleaning , editor '' , ! ! [eos] cls0 - sp2 : -32.88 -1.93 18 0.06 [bos] `` she first cleaning , editor '' , ! ! had in a ! ! . [eos] cls0 - sp3 : -33.03 -1.94 18 0.06 [bos] `` she first cleaning , editor '' , ! ! ! in a ! ! . [eos] cls0 - sp4 : -33.25 -1.96 18 0.00 [bos] `` she first cleaning , editor '' , no ! had in a ! ! . [eos] cls1 - sp0 : -27.18 -2.47 12 0.27 [bos] '' couldn't first discussed , streets '' , ! ! [eos] cls1 - sp1 : -27.22 -2.47 12 0.27 [bos] '' couldn't first discussed , damn '' , ! ! [eos] cls1 - sp2 : -27.32 -2.48 12 0.27 [bos] '' couldn't first discussed , dr. '' , ! ! [eos] cls1 - sp3 : -27.36 -2.49 12 0.27 [bos] '' couldn't first discussed , cleaning '' , ! ! [eos] cls1 - sp4 : -27.63 -2.51 12 0.27 [bos] '' couldn't first discussed , couldn't '' , ! ! [eos] cls2 - sp0 : -27.35 -2.49 12 0.55 [bos] `` all she mississippi , 7 '' , ! ! [eos] cls2 - sp1 : -27.38 -2.49 12 0.64 [bos] `` all she mississippi , telephone '' , ! ! [eos] cls2 - sp2 : -27.39 -2.49 12 0.55 [bos] : all she mississippi , telephone '' , ! ! [eos] cls2 - sp3 : -27.51 -2.50 12 0.55 [bos] `` all she mississippi , telephone '' , ! ! [eos] cls2 - sp4 : -27.54 -2.50 12 0.55 [bos] `` all she flung , 7 '' , ! ! [eos] cls3 - sp0 : -26.80 -2.44 12 1.00 [bos] when she first corner , telephone '' , ! ! [eos] cls3 - sp1 : -27.58 -2.51 12 1.00 [bos] when she first corner , corner '' , ! ! [eos] cls3 - sp2 : -27.74 -2.52 12 1.00 [bos] when she first reliable , corner '' , ! ! [eos] cls3 - sp3 : -32.26 -1.90 18 1.00 [bos] when she first corner , corner '' , ! ! ! in a ! ! . [eos] cls3 - sp4 : -32.27 -1.90 18 1.00 [bos] when she first reliable , corner '' , ! ! ! in a ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-361 src: none none 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt0: mod/noi/dif/loss/nce/logp -83.42 /-1.74 /-81.68 /0.69/-0.69 -4.91 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt1: mod/noi/dif/loss/nce/logp -83.42 /-1.74 /-81.68 / /-0.69 -4.91 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt2: mod/noi/dif/loss/nce/logp -273.21/-11.56 /-261.65/ /-180.66 -34.15/-1.45 9 [bos] `` it's perfectly understandable , arlene . [eos] tgt3: mod/noi/dif/loss/nce/logp -124.04/-12.71 /-111.33/ /-30.35 -7.75 /-0.79 17 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way [eos] tgt4: mod/noi/dif/loss/nce/logp -211.80/-12.08 /-199.72/ /-118.73 -30.26/-1.73 8 [bos] `` it's perfectly understandable , arlene [eos] tgt5: mod/noi/dif/loss/nce/logp -208.26/-12.29 /-195.96/ /-114.98 -23.14/-1.37 10 [bos] `` it's perfectly understandable , arlene '' . [eos] cls0 - sp0 : -24.23 -2.20 12 0.09 [bos] `` she first cleaning , streets '' , ! ! [eos] cls0 - sp1 : -25.24 -2.29 12 0.09 [bos] `` she first cleaning , editor '' , ! ! [eos] cls0 - sp2 : -32.88 -1.93 18 0.06 [bos] `` she first cleaning , editor '' , ! ! had in a ! ! . [eos] cls0 - sp3 : -33.03 -1.94 18 0.06 [bos] `` she first cleaning , editor '' , ! ! ! in a ! ! . [eos] cls0 - sp4 : -33.25 -1.96 18 0.00 [bos] `` she first cleaning , editor '' , no ! had in a ! ! . [eos] cls1 - sp0 : -27.18 -2.47 12 0.27 [bos] '' couldn't first discussed , streets '' , ! ! [eos] cls1 - sp1 : -27.22 -2.47 12 0.27 [bos] '' couldn't first discussed , damn '' , ! ! [eos] cls1 - sp2 : -27.32 -2.48 12 0.27 [bos] '' couldn't first discussed , dr. '' , ! ! [eos] cls1 - sp3 : -27.36 -2.49 12 0.27 [bos] '' couldn't first discussed , cleaning '' , ! ! [eos] cls1 - sp4 : -27.63 -2.51 12 0.27 [bos] '' couldn't first discussed , couldn't '' , ! ! [eos] cls2 - sp0 : -27.35 -2.49 12 0.55 [bos] `` all she mississippi , 7 '' , ! ! [eos] cls2 - sp1 : -27.38 -2.49 12 0.64 [bos] `` all she mississippi , telephone '' , ! ! [eos] cls2 - sp2 : -27.39 -2.49 12 0.55 [bos] : all she mississippi , telephone '' , ! ! [eos] cls2 - sp3 : -27.51 -2.50 12 0.55 [bos] `` all she mississippi , telephone '' , ! ! [eos] cls2 - sp4 : -27.54 -2.50 12 0.55 [bos] `` all she flung , 7 '' , ! ! [eos] cls3 - sp0 : -26.80 -2.44 12 1.00 [bos] when she first corner , telephone '' , ! ! [eos] cls3 - sp1 : -27.58 -2.51 12 1.00 [bos] when she first corner , corner '' , ! ! [eos] cls3 - sp2 : -27.74 -2.52 12 1.00 [bos] when she first reliable , corner '' , ! ! [eos] cls3 - sp3 : -32.26 -1.90 18 1.00 [bos] when she first corner , corner '' , ! ! ! in a ! ! . [eos] cls3 - sp4 : -32.27 -1.90 18 1.00 [bos] when she first reliable , corner '' , ! ! ! in a ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-362 src: none none 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt0: mod/noi/dif/loss/nce/logp -84.47 /-1.74 /-82.73 /0.69/-0.69 -4.97 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt1: mod/noi/dif/loss/nce/logp -84.47 /-1.74 /-82.73 / /-0.69 -4.97 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt2: mod/noi/dif/loss/nce/logp -299.56/-11.56 /-288.00/ /-205.96 -37.45/-1.45 9 [bos] `` it's perfectly understandable , arlene . [eos] tgt3: mod/noi/dif/loss/nce/logp -120.38/-12.71 /-107.67/ /-25.64 -7.52 /-0.79 17 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way [eos] tgt4: mod/noi/dif/loss/nce/logp -221.39/-12.08 /-209.30/ /-127.27 -31.63/-1.73 8 [bos] `` it's perfectly understandable , arlene [eos] tgt5: mod/noi/dif/loss/nce/logp -269.36/-12.29 /-257.07/ /-175.03 -29.93/-1.37 10 [bos] `` it's perfectly understandable , arlene '' . [eos] cls0 - sp0 : -29.65 -1.74 18 0.06 [bos] '' couldn't couldn't ) , dr. '' , there . is in a streets all . [eos] cls0 - sp1 : -29.87 -1.76 18 0.06 [bos] '' couldn't couldn't ) , dr. '' , there . is in a couldn't all . [eos] cls0 - sp2 : -29.91 -1.76 18 0.06 [bos] '' i couldn't ) , dr. '' , there . is in a streets all . [eos] cls0 - sp3 : -29.95 -1.76 18 0.06 [bos] '' i couldn't ) , streets '' , has . is in a streets all . [eos] cls0 - sp4 : -30.02 -1.77 18 0.06 [bos] '' couldn't couldn't ) , dr. '' , has . is in a streets all . [eos] cls1 - sp0 : -24.29 -2.21 12 0.27 [bos] ! ! ( ) , pain '' , ! . [eos] cls1 - sp1 : -24.45 -2.22 12 0.27 [bos] ! ! ( ) , dr. '' , ! . [eos] cls1 - sp2 : -24.84 -2.26 12 0.27 [bos] ! ! ( ) , editor '' , ! . [eos] cls1 - sp3 : -26.12 -2.18 13 0.25 [bos] ! ! ( ) , pain '' , later . ! [eos] cls1 - sp4 : -26.63 -2.22 13 0.25 [bos] ! ! ( ) , cleaning '' , later . ! [eos] cls2 - sp0 : -34.87 -2.05 18 0.53 [bos] ! ! ( ) , telephone '' , has . is in a corner all . [eos] cls2 - sp1 : -34.93 -2.05 18 0.53 [bos] ! ! ( ) , 7 '' , later . is in a corner all . [eos] cls2 - sp2 : -35.20 -2.07 18 0.53 [bos] ! ! ( ) , 7 '' , has . is in a corner all . [eos] cls2 - sp3 : -35.50 -2.09 18 0.53 [bos] ! ! ( ) , 7 '' , later . is in a telephone all . [eos] cls2 - sp4 : -35.53 -2.09 18 0.53 [bos] ! ! ( ) , 7 '' , later . is in a corner ! . [eos] cls3 - sp0 : -30.49 -1.79 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a corner ! . [eos] cls3 - sp1 : -30.49 -1.79 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a personal all . [eos] cls3 - sp2 : -30.60 -1.80 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a telephone all . [eos] cls3 - sp3 : -30.71 -1.81 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a situation all . [eos] cls3 - sp4 : -30.90 -1.82 18 0.94 [bos] ! ! ( ) , telephone '' , later . is in a corner ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-363 src: none none 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt0: mod/noi/dif/loss/nce/logp -83.24 /-1.74 /-81.49 /0.69/-0.69 -4.90 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt1: mod/noi/dif/loss/nce/logp -83.24 /-1.74 /-81.49 / /-0.69 -4.90 /-0.10 18 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way . [eos] tgt2: mod/noi/dif/loss/nce/logp -281.20/-11.56 /-269.64/ /-188.84 -35.15/-1.45 9 [bos] `` it's perfectly understandable , arlene . [eos] tgt3: mod/noi/dif/loss/nce/logp -123.57/-12.71 /-110.86/ /-30.06 -7.72 /-0.79 17 [bos] `` it's perfectly understandable , arlene '' , my mother said in a friendly way [eos] tgt4: mod/noi/dif/loss/nce/logp -210.29/-12.08 /-198.20/ /-117.40 -30.04/-1.73 8 [bos] `` it's perfectly understandable , arlene [eos] tgt5: mod/noi/dif/loss/nce/logp -261.73/-12.29 /-249.44/ /-168.64 -29.08/-1.37 10 [bos] `` it's perfectly understandable , arlene '' . [eos] cls0 - sp0 : -29.65 -1.74 18 0.06 [bos] '' couldn't couldn't ) , dr. '' , there . is in a streets all . [eos] cls0 - sp1 : -29.87 -1.76 18 0.06 [bos] '' couldn't couldn't ) , dr. '' , there . is in a couldn't all . [eos] cls0 - sp2 : -29.91 -1.76 18 0.06 [bos] '' i couldn't ) , dr. '' , there . is in a streets all . [eos] cls0 - sp3 : -29.95 -1.76 18 0.06 [bos] '' i couldn't ) , streets '' , has . is in a streets all . [eos] cls0 - sp4 : -30.02 -1.77 18 0.06 [bos] '' couldn't couldn't ) , dr. '' , has . is in a streets all . [eos] cls1 - sp0 : -24.29 -2.21 12 0.27 [bos] ! ! ( ) , pain '' , ! . [eos] cls1 - sp1 : -24.45 -2.22 12 0.27 [bos] ! ! ( ) , dr. '' , ! . [eos] cls1 - sp2 : -24.84 -2.26 12 0.27 [bos] ! ! ( ) , editor '' , ! . [eos] cls1 - sp3 : -26.12 -2.18 13 0.25 [bos] ! ! ( ) , pain '' , later . ! [eos] cls1 - sp4 : -26.63 -2.22 13 0.25 [bos] ! ! ( ) , cleaning '' , later . ! [eos] cls2 - sp0 : -34.87 -2.05 18 0.53 [bos] ! ! ( ) , telephone '' , has . is in a corner all . [eos] cls2 - sp1 : -34.93 -2.05 18 0.53 [bos] ! ! ( ) , 7 '' , later . is in a corner all . [eos] cls2 - sp2 : -35.20 -2.07 18 0.53 [bos] ! ! ( ) , 7 '' , has . is in a corner all . [eos] cls2 - sp3 : -35.50 -2.09 18 0.53 [bos] ! ! ( ) , 7 '' , later . is in a telephone all . [eos] cls2 - sp4 : -35.53 -2.09 18 0.53 [bos] ! ! ( ) , 7 '' , later . is in a corner ! . [eos] cls3 - sp0 : -30.49 -1.79 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a corner ! . [eos] cls3 - sp1 : -30.49 -1.79 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a personal all . [eos] cls3 - sp2 : -30.60 -1.80 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a telephone all . [eos] cls3 - sp3 : -30.71 -1.81 18 1.00 [bos] ! ! ( ) , telephone '' , later . is in a situation all . [eos] cls3 - sp4 : -30.90 -1.82 18 0.94 [bos] ! ! ( ) , telephone '' , later . is in a corner ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-364 src: none none 9 [bos] but it made her look unusual . [eos] tgt0: mod/noi/dif/loss/nce/logp -33.98 /-0.89 /-33.09 /0.69/-0.69 -4.25 /-0.11 9 [bos] but it made her look unusual . [eos] tgt1: mod/noi/dif/loss/nce/logp -33.98 /-0.89 /-33.09 / /-0.69 -4.25 /-0.11 9 [bos] but it made her look unusual . [eos] tgt2: mod/noi/dif/loss/nce/logp -63.73 /-11.77 /-51.97 / /-19.57 -9.10 /-1.68 8 [bos] but it made her look unusual [eos] tgt3: mod/noi/dif/loss/nce/logp -57.13 /-11.95 /-45.18 / /-12.78 -7.14 /-1.49 9 [bos] but the made her look unusual . [eos] tgt4: mod/noi/dif/loss/nce/logp -52.57 /-11.52 /-41.05 / /-8.65 -6.57 /-1.44 9 [bos] but and made her look unusual . [eos] tgt5: mod/noi/dif/loss/nce/logp -70.51 /-12.06 /-58.46 / /-26.06 -7.83 /-1.34 10 [bos] but it made her look unusual . . [eos] cls0 - sp0 : -8.51 -1.70 6 0.20 [bos] ! it ! ! [eos] cls0 - sp1 : -8.71 -1.74 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -8.73 -1.75 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -8.85 -1.77 6 0.20 [bos] ! it ! ! [eos] cls0 - sp4 : -8.91 -1.78 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -7.91 -1.58 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -8.34 -1.67 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -8.35 -1.67 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -8.43 -1.69 6 0.40 [bos] ! it ! ! [eos] cls1 - sp4 : -8.81 -1.76 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -7.54 -1.51 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -7.92 -1.58 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -8.32 -1.66 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -8.51 -1.70 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -9.59 -1.92 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -7.36 -1.47 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -7.51 -1.50 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.26 -1.65 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -8.77 -1.75 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -9.03 -1.81 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-365 src: none none 9 [bos] but it made her look unusual . [eos] tgt0: mod/noi/dif/loss/nce/logp -36.04 /-0.89 /-35.15 /0.69/-0.69 -4.51 /-0.11 9 [bos] but it made her look unusual . [eos] tgt1: mod/noi/dif/loss/nce/logp -36.04 /-0.89 /-35.15 / /-0.69 -4.51 /-0.11 9 [bos] but it made her look unusual . [eos] tgt2: mod/noi/dif/loss/nce/logp -66.99 /-11.77 /-55.22 / /-20.76 -9.57 /-1.68 8 [bos] but it made her look unusual [eos] tgt3: mod/noi/dif/loss/nce/logp -59.44 /-11.95 /-47.49 / /-13.03 -7.43 /-1.49 9 [bos] but the made her look unusual . [eos] tgt4: mod/noi/dif/loss/nce/logp -53.87 /-11.52 /-42.34 / /-7.88 -6.73 /-1.44 9 [bos] but and made her look unusual . [eos] tgt5: mod/noi/dif/loss/nce/logp -74.48 /-12.06 /-62.43 / /-27.96 -8.28 /-1.34 10 [bos] but it made her look unusual . . [eos] cls0 - sp0 : -8.51 -1.70 6 0.20 [bos] ! it ! ! [eos] cls0 - sp1 : -8.71 -1.74 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -8.73 -1.75 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -8.85 -1.77 6 0.20 [bos] ! it ! ! [eos] cls0 - sp4 : -8.91 -1.78 6 0.20 [bos] ! ! ! ! [eos] cls1 - sp0 : -7.91 -1.58 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -8.34 -1.67 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -8.35 -1.67 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -8.43 -1.69 6 0.40 [bos] ! it ! ! [eos] cls1 - sp4 : -8.81 -1.76 6 0.40 [bos] ! ! ! ! [eos] cls2 - sp0 : -7.54 -1.51 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -7.92 -1.58 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -8.32 -1.66 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -8.51 -1.70 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -9.59 -1.92 6 0.60 [bos] ! ! ! ! [eos] cls3 - sp0 : -7.36 -1.47 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -7.51 -1.50 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.26 -1.65 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -8.77 -1.75 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp4 : -9.03 -1.81 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-366 src: none none 9 [bos] but it made her look unusual . [eos] tgt0: mod/noi/dif/loss/nce/logp -34.04 /-0.89 /-33.15 /0.69/-0.69 -4.25 /-0.11 9 [bos] but it made her look unusual . [eos] tgt1: mod/noi/dif/loss/nce/logp -34.04 /-0.89 /-33.15 / /-0.69 -4.25 /-0.11 9 [bos] but it made her look unusual . [eos] tgt2: mod/noi/dif/loss/nce/logp -63.23 /-11.77 /-51.46 / /-19.00 -9.03 /-1.68 8 [bos] but it made her look unusual [eos] tgt3: mod/noi/dif/loss/nce/logp -56.35 /-11.95 /-44.39 / /-11.94 -7.04 /-1.49 9 [bos] but the made her look unusual . [eos] tgt4: mod/noi/dif/loss/nce/logp -52.86 /-11.52 /-41.34 / /-8.88 -6.61 /-1.44 9 [bos] but and made her look unusual . [eos] tgt5: mod/noi/dif/loss/nce/logp -69.56 /-12.06 /-57.50 / /-25.04 -7.73 /-1.34 10 [bos] but it made her look unusual . . [eos] cls0 - sp0 : -8.59 -1.72 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -8.76 -1.75 6 0.20 [bos] ! it ! ! [eos] cls0 - sp2 : -8.80 -1.76 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -8.84 -1.77 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -9.07 -1.81 6 0.20 [bos] ! it ! ! [eos] cls1 - sp0 : -7.83 -1.57 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -8.07 -1.61 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -8.12 -1.62 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -8.29 -1.66 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -8.52 -1.70 6 0.40 [bos] ! it ! ! [eos] cls2 - sp0 : -7.20 -1.44 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -7.21 -1.44 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -7.32 -1.46 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -7.94 -1.59 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -8.84 -1.77 6 0.60 [bos] ! it ! ! [eos] cls3 - sp0 : -6.32 -1.26 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -8.09 -1.62 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.85 -1.77 6 0.80 [bos] ! ! ! been [eos] cls3 - sp3 : -8.91 -1.78 6 0.80 [bos] ! ! no ! [eos] cls3 - sp4 : -9.23 -1.85 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-367 src: none none 9 [bos] but it made her look unusual . [eos] tgt0: mod/noi/dif/loss/nce/logp -37.80 /-0.89 /-36.92 /0.69/-0.69 -4.73 /-0.11 9 [bos] but it made her look unusual . [eos] tgt1: mod/noi/dif/loss/nce/logp -37.80 /-0.89 /-36.92 / /-0.69 -4.73 /-0.11 9 [bos] but it made her look unusual . [eos] tgt2: mod/noi/dif/loss/nce/logp -67.71 /-11.77 /-55.94 / /-19.72 -9.67 /-1.68 8 [bos] but it made her look unusual [eos] tgt3: mod/noi/dif/loss/nce/logp -60.43 /-11.95 /-48.48 / /-12.26 -7.55 /-1.49 9 [bos] but the made her look unusual . [eos] tgt4: mod/noi/dif/loss/nce/logp -55.67 /-11.52 /-44.14 / /-7.92 -6.96 /-1.44 9 [bos] but and made her look unusual . [eos] tgt5: mod/noi/dif/loss/nce/logp -75.97 /-12.06 /-63.91 / /-27.69 -8.44 /-1.34 10 [bos] but it made her look unusual . . [eos] cls0 - sp0 : -8.59 -1.72 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -8.76 -1.75 6 0.20 [bos] ! it ! ! [eos] cls0 - sp2 : -8.80 -1.76 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp3 : -8.84 -1.77 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp4 : -9.07 -1.81 6 0.20 [bos] ! it ! ! [eos] cls1 - sp0 : -7.83 -1.57 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -8.07 -1.61 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -8.12 -1.62 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp3 : -8.29 -1.66 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -8.52 -1.70 6 0.40 [bos] ! it ! ! [eos] cls2 - sp0 : -7.20 -1.44 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -7.21 -1.44 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -7.32 -1.46 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -7.94 -1.59 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp4 : -8.84 -1.77 6 0.60 [bos] ! it ! ! [eos] cls3 - sp0 : -6.32 -1.26 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -8.09 -1.62 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -8.85 -1.77 6 0.80 [bos] ! ! ! been [eos] cls3 - sp3 : -8.91 -1.78 6 0.80 [bos] ! ! no ! [eos] cls3 - sp4 : -9.23 -1.85 6 0.80 [bos] ! ! ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-368 src: none none 8 [bos] and i found a radish . [eos] tgt0: mod/noi/dif/loss/nce/logp -45.62 /-0.78 /-44.84 /15.86/-15.86 -6.52 /-0.11 8 [bos] and i found a radish . [eos] tgt1: mod/noi/dif/loss/nce/logp -45.62 /-0.78 /-44.84 / /-15.86 -6.52 /-0.11 8 [bos] and i found a radish . [eos] tgt2: mod/noi/dif/loss/nce/logp -41.96 /-12.01 /-29.94 / /-0.96 -5.99 /-1.72 8 [bos] and i found a dictionary . [eos] tgt3: mod/noi/dif/loss/nce/logp -42.09 /-12.46 /-29.63 / /-0.64 -6.01 /-1.78 8 [bos] and i found a turn . [eos] tgt4: mod/noi/dif/loss/nce/logp -44.39 /-12.74 /-31.65 / /-2.67 -6.34 /-1.82 8 [bos] and i found a manipulation . [eos] tgt5: mod/noi/dif/loss/nce/logp -45.23 /-12.52 /-32.71 / /-3.73 -6.46 /-1.79 8 [bos] and i found a farewell . [eos] cls0 - sp0 : -7.39 -1.48 6 0.20 [bos] ! ! ! a [eos] cls0 - sp1 : -8.04 -1.61 6 0.00 [bos] ! ! ! a [eos] cls0 - sp2 : -8.17 -1.63 6 0.20 [bos] ! ! ! a [eos] cls0 - sp3 : -8.32 -1.66 6 0.20 [bos] ! ! ! a [eos] cls0 - sp4 : -8.71 -1.74 6 0.20 [bos] ! ! ! a [eos] cls1 - sp0 : -7.13 -1.43 6 0.40 [bos] ! ! ! a [eos] cls1 - sp1 : -7.39 -1.48 6 0.40 [bos] ! ! ! a [eos] cls1 - sp2 : -7.50 -1.50 6 0.40 [bos] ! ! ! a [eos] cls1 - sp3 : -8.11 -1.62 6 0.40 [bos] ! ! ! a [eos] cls1 - sp4 : -8.29 -1.66 6 0.40 [bos] ! ! ! a [eos] cls2 - sp0 : -6.67 -1.33 6 0.60 [bos] ! ! ! a [eos] cls2 - sp1 : -6.80 -1.36 6 0.60 [bos] ! ! ! a [eos] cls2 - sp2 : -6.88 -1.38 6 0.60 [bos] ! ! ! a [eos] cls2 - sp3 : -7.87 -1.57 6 0.60 [bos] ! ! ! a [eos] cls2 - sp4 : -10.22 -2.04 6 0.60 [bos] ! ! ! a [eos] cls3 - sp0 : -5.87 -1.17 6 0.80 [bos] ! ! ! a [eos] cls3 - sp1 : -7.73 -1.55 6 1.00 [bos] ! ! ! a [eos] cls3 - sp2 : -9.09 -1.82 6 0.80 [bos] ! ! ! a [eos] cls3 - sp3 : -9.21 -1.84 6 0.80 [bos] ! ! ! a [eos] cls3 - sp4 : -9.45 -1.89 6 0.80 [bos] ! ! ! a [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-369 src: none none 8 [bos] and i found a radish . [eos] tgt0: mod/noi/dif/loss/nce/logp -48.75 /-0.78 /-47.97 /15.37/-15.37 -6.96 /-0.11 8 [bos] and i found a radish . [eos] tgt1: mod/noi/dif/loss/nce/logp -48.75 /-0.78 /-47.97 / /-15.37 -6.96 /-0.11 8 [bos] and i found a radish . [eos] tgt2: mod/noi/dif/loss/nce/logp -44.92 /-12.01 /-32.91 / /-0.31 -6.42 /-1.72 8 [bos] and i found a dictionary . [eos] tgt3: mod/noi/dif/loss/nce/logp -46.58 /-12.46 /-34.12 / /-1.52 -6.65 /-1.78 8 [bos] and i found a turn . [eos] tgt4: mod/noi/dif/loss/nce/logp -48.65 /-12.74 /-35.91 / /-3.31 -6.95 /-1.82 8 [bos] and i found a manipulation . [eos] tgt5: mod/noi/dif/loss/nce/logp -49.41 /-12.52 /-36.89 / /-4.29 -7.06 /-1.79 8 [bos] and i found a farewell . [eos] cls0 - sp0 : -7.39 -1.48 6 0.20 [bos] ! ! ! a [eos] cls0 - sp1 : -8.04 -1.61 6 0.00 [bos] ! ! ! a [eos] cls0 - sp2 : -8.17 -1.63 6 0.20 [bos] ! ! ! a [eos] cls0 - sp3 : -8.32 -1.66 6 0.20 [bos] ! ! ! a [eos] cls0 - sp4 : -8.71 -1.74 6 0.20 [bos] ! ! ! a [eos] cls1 - sp0 : -7.13 -1.43 6 0.40 [bos] ! ! ! a [eos] cls1 - sp1 : -7.39 -1.48 6 0.40 [bos] ! ! ! a [eos] cls1 - sp2 : -7.50 -1.50 6 0.40 [bos] ! ! ! a [eos] cls1 - sp3 : -8.11 -1.62 6 0.40 [bos] ! ! ! a [eos] cls1 - sp4 : -8.29 -1.66 6 0.40 [bos] ! ! ! a [eos] cls2 - sp0 : -6.67 -1.33 6 0.60 [bos] ! ! ! a [eos] cls2 - sp1 : -6.80 -1.36 6 0.60 [bos] ! ! ! a [eos] cls2 - sp2 : -6.88 -1.38 6 0.60 [bos] ! ! ! a [eos] cls2 - sp3 : -7.87 -1.57 6 0.60 [bos] ! ! ! a [eos] cls2 - sp4 : -10.22 -2.04 6 0.60 [bos] ! ! ! a [eos] cls3 - sp0 : -5.87 -1.17 6 0.80 [bos] ! ! ! a [eos] cls3 - sp1 : -7.73 -1.55 6 1.00 [bos] ! ! ! a [eos] cls3 - sp2 : -9.09 -1.82 6 0.80 [bos] ! ! ! a [eos] cls3 - sp3 : -9.21 -1.84 6 0.80 [bos] ! ! ! a [eos] cls3 - sp4 : -9.45 -1.89 6 0.80 [bos] ! ! ! a [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-370 src: none none 8 [bos] and i found a radish . [eos] tgt0: mod/noi/dif/loss/nce/logp -45.08 /-0.78 /-44.30 /16.09/-16.09 -6.44 /-0.11 8 [bos] and i found a radish . [eos] tgt1: mod/noi/dif/loss/nce/logp -45.08 /-0.78 /-44.30 / /-16.09 -6.44 /-0.11 8 [bos] and i found a radish . [eos] tgt2: mod/noi/dif/loss/nce/logp -41.16 /-12.01 /-29.14 / /-0.93 -5.88 /-1.72 8 [bos] and i found a dictionary . [eos] tgt3: mod/noi/dif/loss/nce/logp -41.32 /-12.46 /-28.86 / /-0.65 -5.90 /-1.78 8 [bos] and i found a turn . [eos] tgt4: mod/noi/dif/loss/nce/logp -43.87 /-12.74 /-31.14 / /-2.92 -6.27 /-1.82 8 [bos] and i found a manipulation . [eos] tgt5: mod/noi/dif/loss/nce/logp -44.32 /-12.52 /-31.80 / /-3.58 -6.33 /-1.79 8 [bos] and i found a farewell . [eos] cls0 - sp0 : -6.69 -1.34 6 0.20 [bos] ! ! ! a [eos] cls0 - sp1 : -7.26 -1.45 6 0.00 [bos] ! ! ! a [eos] cls0 - sp2 : -7.43 -1.49 6 0.20 [bos] ! ! ! a [eos] cls0 - sp3 : -7.80 -1.56 6 0.20 [bos] ! ! ! a [eos] cls0 - sp4 : -7.94 -1.59 6 0.20 [bos] ! ! ! a [eos] cls1 - sp0 : -6.44 -1.29 6 0.40 [bos] ! ! ! a [eos] cls1 - sp1 : -6.73 -1.35 6 0.40 [bos] ! ! ! a [eos] cls1 - sp2 : -6.84 -1.37 6 0.40 [bos] ! ! ! a [eos] cls1 - sp3 : -7.51 -1.50 6 0.40 [bos] ! ! ! a [eos] cls1 - sp4 : -7.72 -1.54 6 0.40 [bos] ! ! ! a [eos] cls2 - sp0 : -5.97 -1.19 6 0.60 [bos] ! ! ! a [eos] cls2 - sp1 : -6.08 -1.22 6 0.60 [bos] ! ! ! a [eos] cls2 - sp2 : -6.12 -1.22 6 0.60 [bos] ! ! ! a [eos] cls2 - sp3 : -7.29 -1.46 6 0.60 [bos] ! ! ! a [eos] cls2 - sp4 : -7.80 -1.95 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -5.12 -1.02 6 0.80 [bos] ! ! ! a [eos] cls3 - sp1 : -7.45 -1.49 6 1.00 [bos] ! ! ! a [eos] cls3 - sp2 : -8.05 -1.61 6 0.80 [bos] ! ! ! ) [eos] cls3 - sp3 : -8.63 -1.73 6 1.00 [bos] ! ! ! ) [eos] cls3 - sp4 : -8.68 -1.74 6 0.80 [bos] ! ! ! a [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-371 src: none none 8 [bos] and i found a radish . [eos] tgt0: mod/noi/dif/loss/nce/logp -47.90 /-0.78 /-47.13 /15.5/-15.50 -6.84 /-0.11 8 [bos] and i found a radish . [eos] tgt1: mod/noi/dif/loss/nce/logp -47.90 /-0.78 /-47.13 / /-15.50 -6.84 /-0.11 8 [bos] and i found a radish . [eos] tgt2: mod/noi/dif/loss/nce/logp -43.93 /-12.01 /-31.92 / /-0.30 -6.28 /-1.72 8 [bos] and i found a dictionary . [eos] tgt3: mod/noi/dif/loss/nce/logp -45.69 /-12.46 /-33.23 / /-1.60 -6.53 /-1.78 8 [bos] and i found a turn . [eos] tgt4: mod/noi/dif/loss/nce/logp -47.63 /-12.74 /-34.90 / /-3.27 -6.80 /-1.82 8 [bos] and i found a manipulation . [eos] tgt5: mod/noi/dif/loss/nce/logp -48.22 /-12.52 /-35.70 / /-4.07 -6.89 /-1.79 8 [bos] and i found a farewell . [eos] cls0 - sp0 : -6.69 -1.34 6 0.20 [bos] ! ! ! a [eos] cls0 - sp1 : -7.26 -1.45 6 0.00 [bos] ! ! ! a [eos] cls0 - sp2 : -7.43 -1.49 6 0.20 [bos] ! ! ! a [eos] cls0 - sp3 : -7.80 -1.56 6 0.20 [bos] ! ! ! a [eos] cls0 - sp4 : -7.94 -1.59 6 0.20 [bos] ! ! ! a [eos] cls1 - sp0 : -6.44 -1.29 6 0.40 [bos] ! ! ! a [eos] cls1 - sp1 : -6.73 -1.35 6 0.40 [bos] ! ! ! a [eos] cls1 - sp2 : -6.84 -1.37 6 0.40 [bos] ! ! ! a [eos] cls1 - sp3 : -7.51 -1.50 6 0.40 [bos] ! ! ! a [eos] cls1 - sp4 : -7.72 -1.54 6 0.40 [bos] ! ! ! a [eos] cls2 - sp0 : -5.97 -1.19 6 0.60 [bos] ! ! ! a [eos] cls2 - sp1 : -6.08 -1.22 6 0.60 [bos] ! ! ! a [eos] cls2 - sp2 : -6.12 -1.22 6 0.60 [bos] ! ! ! a [eos] cls2 - sp3 : -7.29 -1.46 6 0.60 [bos] ! ! ! a [eos] cls2 - sp4 : -7.80 -1.95 5 0.50 [bos] ! ! ! [eos] cls3 - sp0 : -5.12 -1.02 6 0.80 [bos] ! ! ! a [eos] cls3 - sp1 : -7.45 -1.49 6 1.00 [bos] ! ! ! a [eos] cls3 - sp2 : -8.05 -1.61 6 0.80 [bos] ! ! ! ) [eos] cls3 - sp3 : -8.63 -1.73 6 1.00 [bos] ! ! ! ) [eos] cls3 - sp4 : -8.68 -1.74 6 0.80 [bos] ! ! ! a [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-372 src: none none 8 [bos] it was in the air . [eos] tgt0: mod/noi/dif/loss/nce/logp -13.19 /-0.87 /-12.32 /0.69/-0.69 -1.88 /-0.12 8 [bos] it was in the air . [eos] tgt1: mod/noi/dif/loss/nce/logp -13.19 /-0.87 /-12.32 / /-0.69 -1.88 /-0.12 8 [bos] it was in the air . [eos] tgt2: mod/noi/dif/loss/nce/logp -43.29 /-11.79 /-31.50 / /-19.88 -7.22 /-1.96 7 [bos] it was in the air [eos] tgt3: mod/noi/dif/loss/nce/logp -36.43 /-11.98 /-24.44 / /-12.82 -5.20 /-1.71 8 [bos] it was of the air . [eos] tgt4: mod/noi/dif/loss/nce/logp -33.60 /-12.08 /-21.52 / /-9.89 -4.80 /-1.73 8 [bos] the was in the air . [eos] tgt5: mod/noi/dif/loss/nce/logp -50.72 /-12.08 /-38.65 / /-27.02 -6.34 /-1.51 9 [bos] it was in the air . . [eos] cls0 - sp0 : -8.97 -1.28 8 0.00 [bos] it was in the streets . [eos] cls0 - sp1 : -9.10 -1.30 8 0.00 [bos] it was in the mean . [eos] cls0 - sp2 : -9.23 -1.32 8 0.00 [bos] it was in the later . [eos] cls0 - sp3 : -9.35 -1.34 8 0.00 [bos] it was in the dr. . [eos] cls0 - sp4 : -9.42 -1.35 8 0.00 [bos] it was in the ! . [eos] cls1 - sp0 : -9.37 -1.34 8 0.43 [bos] it was in the ! . [eos] cls1 - sp1 : -10.20 -1.46 8 0.43 [bos] ! was in the ! . [eos] cls1 - sp2 : -10.37 -1.48 8 0.43 [bos] property was in the ! . [eos] cls1 - sp3 : -10.37 -1.48 8 0.29 [bos] it was in the ! . [eos] cls1 - sp4 : -10.42 -1.49 8 0.43 [bos] we was in the ! . [eos] cls2 - sp0 : -9.48 -1.35 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp1 : -9.63 -1.38 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp2 : -10.80 -1.54 8 0.57 [bos] ! was in the ! . [eos] cls2 - sp3 : -10.83 -1.55 8 0.57 [bos] ! she in the ! . [eos] cls2 - sp4 : -11.47 -1.64 8 0.71 [bos] ! she in the ! . [eos] cls3 - sp0 : -8.95 -1.28 8 0.86 [bos] ! she in the ! ! [eos] cls3 - sp1 : -8.97 -1.28 8 1.00 [bos] ! she in the ! ! [eos] cls3 - sp2 : -9.10 -1.30 8 0.86 [bos] ! she in the 7 . [eos] cls3 - sp3 : -9.16 -1.31 8 0.86 [bos] ! she in the telephone . [eos] cls3 - sp4 : -9.20 -1.31 8 1.00 [bos] ! she in the ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-373 src: none none 8 [bos] it was in the air . [eos] tgt0: mod/noi/dif/loss/nce/logp -15.77 /-0.87 /-14.90 /0.69/-0.69 -2.25 /-0.12 8 [bos] it was in the air . [eos] tgt1: mod/noi/dif/loss/nce/logp -15.77 /-0.87 /-14.90 / /-0.69 -2.25 /-0.12 8 [bos] it was in the air . [eos] tgt2: mod/noi/dif/loss/nce/logp -52.56 /-11.79 /-40.77 / /-26.57 -8.76 /-1.96 7 [bos] it was in the air [eos] tgt3: mod/noi/dif/loss/nce/logp -39.72 /-11.98 /-27.73 / /-13.53 -5.67 /-1.71 8 [bos] it was of the air . [eos] tgt4: mod/noi/dif/loss/nce/logp -38.31 /-12.08 /-26.23 / /-12.03 -5.47 /-1.73 8 [bos] the was in the air . [eos] tgt5: mod/noi/dif/loss/nce/logp -53.31 /-12.08 /-41.23 / /-27.03 -6.66 /-1.51 9 [bos] it was in the air . . [eos] cls0 - sp0 : -8.97 -1.28 8 0.00 [bos] it was in the streets . [eos] cls0 - sp1 : -9.10 -1.30 8 0.00 [bos] it was in the mean . [eos] cls0 - sp2 : -9.23 -1.32 8 0.00 [bos] it was in the later . [eos] cls0 - sp3 : -9.35 -1.34 8 0.00 [bos] it was in the dr. . [eos] cls0 - sp4 : -9.42 -1.35 8 0.00 [bos] it was in the ! . [eos] cls1 - sp0 : -9.37 -1.34 8 0.43 [bos] it was in the ! . [eos] cls1 - sp1 : -10.20 -1.46 8 0.43 [bos] ! was in the ! . [eos] cls1 - sp2 : -10.37 -1.48 8 0.43 [bos] property was in the ! . [eos] cls1 - sp3 : -10.37 -1.48 8 0.29 [bos] it was in the ! . [eos] cls1 - sp4 : -10.42 -1.49 8 0.43 [bos] we was in the ! . [eos] cls2 - sp0 : -9.48 -1.35 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp1 : -9.63 -1.38 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp2 : -10.80 -1.54 8 0.57 [bos] ! was in the ! . [eos] cls2 - sp3 : -10.83 -1.55 8 0.57 [bos] ! she in the ! . [eos] cls2 - sp4 : -11.47 -1.64 8 0.71 [bos] ! she in the ! . [eos] cls3 - sp0 : -8.95 -1.28 8 0.86 [bos] ! she in the ! ! [eos] cls3 - sp1 : -8.97 -1.28 8 1.00 [bos] ! she in the ! ! [eos] cls3 - sp2 : -9.10 -1.30 8 0.86 [bos] ! she in the 7 . [eos] cls3 - sp3 : -9.16 -1.31 8 0.86 [bos] ! she in the telephone . [eos] cls3 - sp4 : -9.20 -1.31 8 1.00 [bos] ! she in the ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-374 src: none none 8 [bos] it was in the air . [eos] tgt0: mod/noi/dif/loss/nce/logp -14.82 /-0.87 /-13.95 /0.69/-0.69 -2.12 /-0.12 8 [bos] it was in the air . [eos] tgt1: mod/noi/dif/loss/nce/logp -14.82 /-0.87 /-13.95 / /-0.69 -2.12 /-0.12 8 [bos] it was in the air . [eos] tgt2: mod/noi/dif/loss/nce/logp -44.10 /-11.79 /-32.31 / /-19.05 -7.35 /-1.96 7 [bos] it was in the air [eos] tgt3: mod/noi/dif/loss/nce/logp -38.02 /-11.98 /-26.03 / /-12.77 -5.43 /-1.71 8 [bos] it was of the air . [eos] tgt4: mod/noi/dif/loss/nce/logp -34.89 /-12.08 /-22.81 / /-9.55 -4.98 /-1.73 8 [bos] the was in the air . [eos] tgt5: mod/noi/dif/loss/nce/logp -50.67 /-12.08 /-38.60 / /-25.34 -6.33 /-1.51 9 [bos] it was in the air . . [eos] cls0 - sp0 : -8.53 -1.22 8 0.14 [bos] ! she in the ! . [eos] cls0 - sp1 : -8.54 -1.22 8 0.00 [bos] we was in the ! . [eos] cls0 - sp2 : -8.63 -1.23 8 0.00 [bos] it was in the i . [eos] cls0 - sp3 : -8.63 -1.23 8 0.00 [bos] we was in the i . [eos] cls0 - sp4 : -8.68 -1.24 8 0.00 [bos] it was in the ! . [eos] cls1 - sp0 : -8.80 -1.26 8 0.29 [bos] ! she in the ! . [eos] cls1 - sp1 : -9.18 -1.31 8 0.43 [bos] ! she in the ! . [eos] cls1 - sp2 : -9.39 -1.34 8 0.43 [bos] it was in the ! . [eos] cls1 - sp3 : -9.54 -1.36 8 0.43 [bos] we was in the ! . [eos] cls1 - sp4 : -9.57 -1.37 8 0.43 [bos] ! ! in the ! . [eos] cls2 - sp0 : -7.55 -1.08 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp1 : -7.76 -1.11 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp2 : -8.13 -1.16 8 0.71 [bos] ! ! in the ! ! [eos] cls2 - sp3 : -8.85 -1.26 8 0.57 [bos] ! she in the ! . [eos] cls2 - sp4 : -9.61 -1.37 8 0.57 [bos] ! ! in the ! . [eos] cls3 - sp0 : -7.06 -1.01 8 0.86 [bos] ! she in the ! . [eos] cls3 - sp1 : -7.09 -1.01 8 1.00 [bos] ! she in the ! . [eos] cls3 - sp2 : -7.24 -1.03 8 1.00 [bos] ! she in the ! ! [eos] cls3 - sp3 : -7.56 -1.08 8 1.00 [bos] ! ! in the ! ! [eos] cls3 - sp4 : -7.67 -1.10 8 0.86 [bos] ! ! in the ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-375 src: none none 8 [bos] it was in the air . [eos] tgt0: mod/noi/dif/loss/nce/logp -18.23 /-0.87 /-17.36 /0.69/-0.69 -2.60 /-0.12 8 [bos] it was in the air . [eos] tgt1: mod/noi/dif/loss/nce/logp -18.23 /-0.87 /-17.36 / /-0.69 -2.60 /-0.12 8 [bos] it was in the air . [eos] tgt2: mod/noi/dif/loss/nce/logp -52.69 /-11.79 /-40.90 / /-24.23 -8.78 /-1.96 7 [bos] it was in the air [eos] tgt3: mod/noi/dif/loss/nce/logp -42.36 /-11.98 /-30.37 / /-13.70 -6.05 /-1.71 8 [bos] it was of the air . [eos] tgt4: mod/noi/dif/loss/nce/logp -40.22 /-12.08 /-28.14 / /-11.47 -5.75 /-1.73 8 [bos] the was in the air . [eos] tgt5: mod/noi/dif/loss/nce/logp -55.18 /-12.08 /-43.10 / /-26.43 -6.90 /-1.51 9 [bos] it was in the air . . [eos] cls0 - sp0 : -8.53 -1.22 8 0.14 [bos] ! she in the ! . [eos] cls0 - sp1 : -8.54 -1.22 8 0.00 [bos] we was in the ! . [eos] cls0 - sp2 : -8.63 -1.23 8 0.00 [bos] it was in the i . [eos] cls0 - sp3 : -8.63 -1.23 8 0.00 [bos] we was in the i . [eos] cls0 - sp4 : -8.68 -1.24 8 0.00 [bos] it was in the ! . [eos] cls1 - sp0 : -8.80 -1.26 8 0.29 [bos] ! she in the ! . [eos] cls1 - sp1 : -9.18 -1.31 8 0.43 [bos] ! she in the ! . [eos] cls1 - sp2 : -9.39 -1.34 8 0.43 [bos] it was in the ! . [eos] cls1 - sp3 : -9.54 -1.36 8 0.43 [bos] we was in the ! . [eos] cls1 - sp4 : -9.57 -1.37 8 0.43 [bos] ! ! in the ! . [eos] cls2 - sp0 : -7.55 -1.08 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp1 : -7.76 -1.11 8 0.71 [bos] ! she in the ! . [eos] cls2 - sp2 : -8.13 -1.16 8 0.71 [bos] ! ! in the ! ! [eos] cls2 - sp3 : -8.85 -1.26 8 0.57 [bos] ! she in the ! . [eos] cls2 - sp4 : -9.61 -1.37 8 0.57 [bos] ! ! in the ! . [eos] cls3 - sp0 : -7.06 -1.01 8 0.86 [bos] ! she in the ! . [eos] cls3 - sp1 : -7.09 -1.01 8 1.00 [bos] ! she in the ! . [eos] cls3 - sp2 : -7.24 -1.03 8 1.00 [bos] ! she in the ! ! [eos] cls3 - sp3 : -7.56 -1.08 8 1.00 [bos] ! ! in the ! ! [eos] cls3 - sp4 : -7.67 -1.10 8 0.86 [bos] ! ! in the ! ! [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-376 src: none none 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt0: mod/noi/dif/loss/nce/logp -28.85 /-1.39 /-27.47 /0.69/-0.69 -2.40 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt1: mod/noi/dif/loss/nce/logp -28.85 /-1.39 /-27.47 / /-0.69 -2.40 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt2: mod/noi/dif/loss/nce/logp -68.86 /-12.55 /-56.31 / /-29.54 -5.30 /-0.97 14 [bos] sometimes , as at this juncture , he did not . . [eos] tgt3: mod/noi/dif/loss/nce/logp -162.91/-12.33 /-150.58/ /-123.80 -20.36/-1.54 9 [bos] sometimes , as at this juncture . [eos] tgt4: mod/noi/dif/loss/nce/logp -48.95 /-11.73 /-37.22 / /-10.45 -4.08 /-0.98 13 [bos] sometimes , as at this juncture , he did , . [eos] tgt5: mod/noi/dif/loss/nce/logp -61.17 /-12.37 /-48.80 / /-22.03 -5.56 /-1.12 12 [bos] sometimes , as at this juncture , he did not [eos] cls0 - sp0 : -15.88 -1.32 13 0.00 [bos] we , as at this joined , it an not . [eos] cls0 - sp1 : -16.01 -1.33 13 0.00 [bos] we , as at this joined , i property not . [eos] cls0 - sp2 : -16.01 -1.33 13 0.00 [bos] we , as at this joined , it property not . [eos] cls0 - sp3 : -16.03 -1.34 13 0.00 [bos] she , as at this joined , it an not . [eos] cls0 - sp4 : -16.04 -1.34 13 0.00 [bos] we , as at this cleaning , it an not . [eos] cls1 - sp0 : -17.75 -1.48 13 0.25 [bos] ! , as at this editor , i ! not . [eos] cls1 - sp1 : -17.79 -1.48 13 0.25 [bos] ! , as at this pain , i ! not . [eos] cls1 - sp2 : -17.85 -1.49 13 0.25 [bos] ! , as at this editor , it ! not . [eos] cls1 - sp3 : -17.87 -1.49 13 0.25 [bos] ! , as at this pain , it ! not . [eos] cls1 - sp4 : -17.88 -1.49 13 0.25 [bos] ! , as at this joined , i ! not . [eos] cls2 - sp0 : -19.13 -1.74 12 0.64 [bos] ! , as at ! ! , ! ! ! [eos] cls2 - sp1 : -19.17 -1.60 13 0.50 [bos] ! , as at this telephone , i ! not . [eos] cls2 - sp2 : -19.18 -1.74 12 0.55 [bos] ! , as at ! ! , ! ! ! [eos] cls2 - sp3 : -19.25 -1.60 13 0.58 [bos] ! , as at this telephone , i property not . [eos] cls2 - sp4 : -19.34 -1.61 13 0.58 [bos] ! , as at this telephone , i ! not . [eos] cls3 - sp0 : -15.40 -1.28 13 1.00 [bos] we , as at this telephone , i an not . [eos] cls3 - sp1 : -15.40 -1.28 13 1.00 [bos] we , as at this telephone , it an not . [eos] cls3 - sp2 : -15.45 -1.29 13 1.00 [bos] we , as at this telephone , i property not . [eos] cls3 - sp3 : -15.47 -1.29 13 1.00 [bos] we , as at this telephone , it property not . [eos] cls3 - sp4 : -15.53 -1.29 13 1.00 [bos] we , as at this telephone , he an not . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-377 src: none none 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt0: mod/noi/dif/loss/nce/logp -27.52 /-1.39 /-26.14 /0.69/-0.69 -2.29 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt1: mod/noi/dif/loss/nce/logp -27.52 /-1.39 /-26.14 / /-0.69 -2.29 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt2: mod/noi/dif/loss/nce/logp -67.10 /-12.55 /-54.55 / /-29.11 -5.16 /-0.97 14 [bos] sometimes , as at this juncture , he did not . . [eos] tgt3: mod/noi/dif/loss/nce/logp -154.81/-12.33 /-142.48/ /-117.03 -19.35/-1.54 9 [bos] sometimes , as at this juncture . [eos] tgt4: mod/noi/dif/loss/nce/logp -47.27 /-11.73 /-35.54 / /-10.10 -3.94 /-0.98 13 [bos] sometimes , as at this juncture , he did , . [eos] tgt5: mod/noi/dif/loss/nce/logp -64.58 /-12.37 /-52.21 / /-26.76 -5.87 /-1.12 12 [bos] sometimes , as at this juncture , he did not [eos] cls0 - sp0 : -15.88 -1.32 13 0.00 [bos] we , as at this joined , it an not . [eos] cls0 - sp1 : -16.01 -1.33 13 0.00 [bos] we , as at this joined , i property not . [eos] cls0 - sp2 : -16.01 -1.33 13 0.00 [bos] we , as at this joined , it property not . [eos] cls0 - sp3 : -16.03 -1.34 13 0.00 [bos] she , as at this joined , it an not . [eos] cls0 - sp4 : -16.04 -1.34 13 0.00 [bos] we , as at this cleaning , it an not . [eos] cls1 - sp0 : -17.75 -1.48 13 0.25 [bos] ! , as at this editor , i ! not . [eos] cls1 - sp1 : -17.79 -1.48 13 0.25 [bos] ! , as at this pain , i ! not . [eos] cls1 - sp2 : -17.85 -1.49 13 0.25 [bos] ! , as at this editor , it ! not . [eos] cls1 - sp3 : -17.87 -1.49 13 0.25 [bos] ! , as at this pain , it ! not . [eos] cls1 - sp4 : -17.88 -1.49 13 0.25 [bos] ! , as at this joined , i ! not . [eos] cls2 - sp0 : -19.13 -1.74 12 0.64 [bos] ! , as at ! ! , ! ! ! [eos] cls2 - sp1 : -19.17 -1.60 13 0.50 [bos] ! , as at this telephone , i ! not . [eos] cls2 - sp2 : -19.18 -1.74 12 0.55 [bos] ! , as at ! ! , ! ! ! [eos] cls2 - sp3 : -19.25 -1.60 13 0.58 [bos] ! , as at this telephone , i property not . [eos] cls2 - sp4 : -19.34 -1.61 13 0.58 [bos] ! , as at this telephone , i ! not . [eos] cls3 - sp0 : -15.40 -1.28 13 1.00 [bos] we , as at this telephone , i an not . [eos] cls3 - sp1 : -15.40 -1.28 13 1.00 [bos] we , as at this telephone , it an not . [eos] cls3 - sp2 : -15.45 -1.29 13 1.00 [bos] we , as at this telephone , i property not . [eos] cls3 - sp3 : -15.47 -1.29 13 1.00 [bos] we , as at this telephone , it property not . [eos] cls3 - sp4 : -15.53 -1.29 13 1.00 [bos] we , as at this telephone , he an not . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-378 src: none none 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt0: mod/noi/dif/loss/nce/logp -29.70 /-1.39 /-28.31 /0.69/-0.69 -2.47 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt1: mod/noi/dif/loss/nce/logp -29.70 /-1.39 /-28.31 / /-0.69 -2.47 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt2: mod/noi/dif/loss/nce/logp -68.65 /-12.55 /-56.10 / /-28.48 -5.28 /-0.97 14 [bos] sometimes , as at this juncture , he did not . . [eos] tgt3: mod/noi/dif/loss/nce/logp -164.25/-12.33 /-151.92/ /-124.30 -20.53/-1.54 9 [bos] sometimes , as at this juncture . [eos] tgt4: mod/noi/dif/loss/nce/logp -48.99 /-11.73 /-37.27 / /-9.65 -4.08 /-0.98 13 [bos] sometimes , as at this juncture , he did , . [eos] tgt5: mod/noi/dif/loss/nce/logp -61.08 /-12.37 /-48.71 / /-21.09 -5.55 /-1.12 12 [bos] sometimes , as at this juncture , he did not [eos] cls0 - sp0 : -4.82 -1.61 4 0.00 [bos] 7 . [eos] cls0 - sp1 : -15.55 -1.30 13 0.00 [bos] ! , as at this joined , i property not . [eos] cls0 - sp2 : -15.60 -1.30 13 0.00 [bos] ! , as at this joined , i when not . [eos] cls0 - sp3 : -15.68 -1.31 13 0.00 [bos] ! , as at this streets , i property not . [eos] cls0 - sp4 : -15.70 -1.31 13 0.00 [bos] ! , as at this streets , i when not . [eos] cls1 - sp0 : -16.40 -1.37 13 0.25 [bos] ! , as at this couldn't , i ! not . [eos] cls1 - sp1 : -16.54 -1.38 13 0.33 [bos] ! , as at ! ! , i ! not . [eos] cls1 - sp2 : -16.59 -1.38 13 0.25 [bos] ! , as at this joined , i ! not . [eos] cls1 - sp3 : -16.59 -1.38 13 0.25 [bos] ! , as at this editor , i ! not . [eos] cls1 - sp4 : -16.60 -1.38 13 0.42 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp0 : -17.21 -1.43 13 0.50 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp1 : -17.30 -1.44 13 0.50 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp2 : -17.30 -1.44 13 0.58 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp3 : -17.43 -1.45 13 0.50 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp4 : -17.57 -1.46 13 0.58 [bos] ! , as at ! ! , ! ! not . [eos] cls3 - sp0 : -15.87 -1.32 13 1.00 [bos] ! , as at this telephone , he property not . [eos] cls3 - sp1 : -15.90 -1.32 13 1.00 [bos] ! , as at this telephone , i property not . [eos] cls3 - sp2 : -15.97 -1.33 13 1.00 [bos] we , as at this telephone , he property not . [eos] cls3 - sp3 : -16.09 -1.34 13 0.92 [bos] ! , as at this telephone , i property not . [eos] cls3 - sp4 : -16.09 -1.34 13 0.92 [bos] ! , as at this telephone , he property not . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-379 src: none none 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt0: mod/noi/dif/loss/nce/logp -28.48 /-1.39 /-27.09 /0.69/-0.69 -2.37 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt1: mod/noi/dif/loss/nce/logp -28.48 /-1.39 /-27.09 / /-0.69 -2.37 /-0.12 13 [bos] sometimes , as at this juncture , he did not . [eos] tgt2: mod/noi/dif/loss/nce/logp -67.85 /-12.55 /-55.30 / /-28.91 -5.22 /-0.97 14 [bos] sometimes , as at this juncture , he did not . . [eos] tgt3: mod/noi/dif/loss/nce/logp -149.55/-12.33 /-137.22/ /-110.82 -18.69/-1.54 9 [bos] sometimes , as at this juncture . [eos] tgt4: mod/noi/dif/loss/nce/logp -47.10 /-11.73 /-35.37 / /-8.98 -3.93 /-0.98 13 [bos] sometimes , as at this juncture , he did , . [eos] tgt5: mod/noi/dif/loss/nce/logp -64.50 /-12.37 /-52.13 / /-25.73 -5.86 /-1.12 12 [bos] sometimes , as at this juncture , he did not [eos] cls0 - sp0 : -4.82 -1.61 4 0.00 [bos] 7 . [eos] cls0 - sp1 : -15.55 -1.30 13 0.00 [bos] ! , as at this joined , i property not . [eos] cls0 - sp2 : -15.60 -1.30 13 0.00 [bos] ! , as at this joined , i when not . [eos] cls0 - sp3 : -15.68 -1.31 13 0.00 [bos] ! , as at this streets , i property not . [eos] cls0 - sp4 : -15.70 -1.31 13 0.00 [bos] ! , as at this streets , i when not . [eos] cls1 - sp0 : -16.40 -1.37 13 0.25 [bos] ! , as at this couldn't , i ! not . [eos] cls1 - sp1 : -16.54 -1.38 13 0.33 [bos] ! , as at ! ! , i ! not . [eos] cls1 - sp2 : -16.59 -1.38 13 0.25 [bos] ! , as at this joined , i ! not . [eos] cls1 - sp3 : -16.59 -1.38 13 0.25 [bos] ! , as at this editor , i ! not . [eos] cls1 - sp4 : -16.60 -1.38 13 0.42 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp0 : -17.21 -1.43 13 0.50 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp1 : -17.30 -1.44 13 0.50 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp2 : -17.30 -1.44 13 0.58 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp3 : -17.43 -1.45 13 0.50 [bos] ! , as at ! ! , i ! not . [eos] cls2 - sp4 : -17.57 -1.46 13 0.58 [bos] ! , as at ! ! , ! ! not . [eos] cls3 - sp0 : -15.87 -1.32 13 1.00 [bos] ! , as at this telephone , he property not . [eos] cls3 - sp1 : -15.90 -1.32 13 1.00 [bos] ! , as at this telephone , i property not . [eos] cls3 - sp2 : -15.97 -1.33 13 1.00 [bos] we , as at this telephone , he property not . [eos] cls3 - sp3 : -16.09 -1.34 13 0.92 [bos] ! , as at this telephone , i property not . [eos] cls3 - sp4 : -16.09 -1.34 13 0.92 [bos] ! , as at this telephone , he property not . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-380 src: none none 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt0: mod/noi/dif/loss/nce/logp -78.15 /-2.29 /-75.86 /0.69/-0.69 -3.72 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt1: mod/noi/dif/loss/nce/logp -78.15 /-2.29 /-75.86 / /-0.69 -3.72 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt2: mod/noi/dif/loss/nce/logp -118.03/-13.18 /-104.85/ /-29.69 -5.90 /-0.66 21 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children [eos] tgt3: mod/noi/dif/loss/nce/logp -97.52 /-12.72 /-84.80 / /-9.63 -4.64 /-0.61 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way [unk] children . [eos] tgt4: mod/noi/dif/loss/nce/logp -196.11/-12.32 /-183.79/ /-108.62 -98.05/-6.16 3 [bos] this [eos] tgt5: mod/noi/dif/loss/nce/logp -97.28 /-13.11 /-84.17 / /-9.01 -4.63 /-0.62 22 [bos] the was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] cls0 - sp0 : -33.59 -1.68 21 0.05 [bos] ! was couldn't in a streets all , i [unk] and [unk] all -- an cleaning be with . [eos] cls0 - sp1 : -33.99 -1.70 21 0.05 [bos] ! was couldn't in a editor all , i [unk] and [unk] all -- an cleaning be with . [eos] cls0 - sp2 : -33.99 -1.70 21 0.05 [bos] ! was couldn't in a streets all , i [unk] and [unk] all -- an cleaning first with . [eos] cls0 - sp3 : -34.60 -1.73 21 0.05 [bos] ! was couldn't in a editor all , i [unk] and [unk] all -- an cleaning first with . [eos] cls0 - sp4 : -34.61 -1.73 21 0.00 [bos] i was couldn't in a streets all , later [unk] and [unk] all -- an cleaning be with . [eos] cls1 - sp0 : -37.41 -1.87 21 0.25 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning be with . [eos] cls1 - sp1 : -37.55 -1.88 21 0.25 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning ! with . [eos] cls1 - sp2 : -37.60 -1.88 21 0.30 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning don't with . [eos] cls1 - sp3 : -38.15 -1.82 22 0.29 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning be with . ! [eos] cls1 - sp4 : -38.29 -1.82 22 0.29 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning couldn't with . ! [eos] cls2 - sp0 : -40.43 -1.93 22 0.62 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone all with can . [eos] cls2 - sp1 : -40.53 -1.93 22 0.57 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone all with can . [eos] cls2 - sp2 : -40.58 -1.93 22 0.62 [bos] ! was joined in a telephone all , ! [unk] and [unk] all -- an telephone all with can . [eos] cls2 - sp3 : -40.68 -1.94 22 0.62 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone be with can . [eos] cls2 - sp4 : -40.68 -1.94 22 0.62 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone all with thought . [eos] cls3 - sp0 : -34.03 -1.62 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone be with center . [eos] cls3 - sp1 : -34.04 -1.62 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone be with state . [eos] cls3 - sp2 : -34.18 -1.63 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone all with state . [eos] cls3 - sp3 : -34.19 -1.63 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone all with center . [eos] cls3 - sp4 : -34.31 -1.63 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone be with thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-381 src: none none 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt0: mod/noi/dif/loss/nce/logp -73.56 /-2.29 /-71.27 /0.69/-0.69 -3.50 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt1: mod/noi/dif/loss/nce/logp -73.56 /-2.29 /-71.27 / /-0.69 -3.50 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt2: mod/noi/dif/loss/nce/logp -116.81/-13.18 /-103.64/ /-33.06 -5.84 /-0.66 21 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children [eos] tgt3: mod/noi/dif/loss/nce/logp -92.95 /-12.72 /-80.23 / /-9.65 -4.43 /-0.61 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way [unk] children . [eos] tgt4: mod/noi/dif/loss/nce/logp -192.70/-12.32 /-180.38/ /-109.80 -96.35/-6.16 3 [bos] this [eos] tgt5: mod/noi/dif/loss/nce/logp -93.94 /-13.11 /-80.83 / /-10.24 -4.47 /-0.62 22 [bos] the was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] cls0 - sp0 : -33.59 -1.68 21 0.05 [bos] ! was couldn't in a streets all , i [unk] and [unk] all -- an cleaning be with . [eos] cls0 - sp1 : -33.99 -1.70 21 0.05 [bos] ! was couldn't in a editor all , i [unk] and [unk] all -- an cleaning be with . [eos] cls0 - sp2 : -33.99 -1.70 21 0.05 [bos] ! was couldn't in a streets all , i [unk] and [unk] all -- an cleaning first with . [eos] cls0 - sp3 : -34.60 -1.73 21 0.05 [bos] ! was couldn't in a editor all , i [unk] and [unk] all -- an cleaning first with . [eos] cls0 - sp4 : -34.61 -1.73 21 0.00 [bos] i was couldn't in a streets all , later [unk] and [unk] all -- an cleaning be with . [eos] cls1 - sp0 : -37.41 -1.87 21 0.25 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning be with . [eos] cls1 - sp1 : -37.55 -1.88 21 0.25 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning ! with . [eos] cls1 - sp2 : -37.60 -1.88 21 0.30 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning don't with . [eos] cls1 - sp3 : -38.15 -1.82 22 0.29 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning be with . ! [eos] cls1 - sp4 : -38.29 -1.82 22 0.29 [bos] ! was editor in a telephone all , i [unk] and [unk] all -- an cleaning couldn't with . ! [eos] cls2 - sp0 : -40.43 -1.93 22 0.62 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone all with can . [eos] cls2 - sp1 : -40.53 -1.93 22 0.57 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone all with can . [eos] cls2 - sp2 : -40.58 -1.93 22 0.62 [bos] ! was joined in a telephone all , ! [unk] and [unk] all -- an telephone all with can . [eos] cls2 - sp3 : -40.68 -1.94 22 0.62 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone be with can . [eos] cls2 - sp4 : -40.68 -1.94 22 0.62 [bos] ! was editor in a telephone all , ! [unk] and [unk] all -- an telephone all with thought . [eos] cls3 - sp0 : -34.03 -1.62 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone be with center . [eos] cls3 - sp1 : -34.04 -1.62 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone be with state . [eos] cls3 - sp2 : -34.18 -1.63 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone all with state . [eos] cls3 - sp3 : -34.19 -1.63 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone all with center . [eos] cls3 - sp4 : -34.31 -1.63 22 1.00 [bos] ! was corner in a telephone all , later [unk] and [unk] all -- an telephone be with thought . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-382 src: none none 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt0: mod/noi/dif/loss/nce/logp -77.01 /-2.29 /-74.72 /0.69/-0.69 -3.67 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt1: mod/noi/dif/loss/nce/logp -77.01 /-2.29 /-74.72 / /-0.69 -3.67 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt2: mod/noi/dif/loss/nce/logp -113.18/-13.18 /-100.00/ /-25.98 -5.66 /-0.66 21 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children [eos] tgt3: mod/noi/dif/loss/nce/logp -96.89 /-12.72 /-84.17 / /-10.14 -4.61 /-0.61 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way [unk] children . [eos] tgt4: mod/noi/dif/loss/nce/logp -168.20/-12.32 /-155.88/ /-81.86 -84.10/-6.16 3 [bos] this [eos] tgt5: mod/noi/dif/loss/nce/logp -95.73 /-13.11 /-82.62 / /-8.59 -4.56 /-0.62 22 [bos] the was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] cls0 - sp0 : -33.20 -1.58 22 0.05 [bos] ! was couldn't in a joined all , later [unk] and [unk] all -- an cleaning all with into . [eos] cls0 - sp1 : -33.33 -1.59 22 0.05 [bos] ! was couldn't in a streets all , later [unk] and [unk] all -- an cleaning all with into . [eos] cls0 - sp2 : -33.42 -1.59 22 0.05 [bos] ! was couldn't in a joined all , later [unk] and [unk] first -- an cleaning all with into . [eos] cls0 - sp3 : -35.00 -1.75 21 0.05 [bos] ! was couldn't in a joined all , ! [unk] and [unk] all -- an cleaning all with . [eos] cls0 - sp4 : -35.23 -1.76 21 0.05 [bos] ! was couldn't in a streets all , later [unk] and [unk] first -- an cleaning all with . [eos] cls1 - sp0 : -36.07 -2.00 19 0.28 [bos] ! was telephone in a joined all , ! [unk] and [unk] she -- an cleaning ! [eos] cls1 - sp1 : -40.30 -2.01 21 0.25 [bos] ! was telephone in a wherever all , ! [unk] and [unk] she -- an cleaning all with . [eos] cls1 - sp2 : -40.57 -2.03 21 0.25 [bos] ! was telephone in a streets all , ! [unk] and [unk] she -- an cleaning all with . [eos] cls1 - sp3 : -40.86 -2.04 21 0.25 [bos] ! was telephone in a streets all , ! [unk] and [unk] don't -- an cleaning all with . [eos] cls1 - sp4 : -40.94 -2.05 21 0.25 [bos] ! was telephone in a cleaning all , ! [unk] and [unk] she -- an cleaning all with . [eos] cls2 - sp0 : -45.41 -2.16 22 0.67 [bos] ! was editor in a corner all , ! [unk] and [unk] made -- an bidding all with just . [eos] cls2 - sp1 : -45.44 -2.16 22 0.67 [bos] ! was editor in a corner all , ! [unk] and [unk] all -- an bidding all with just . [eos] cls2 - sp2 : -45.53 -2.17 22 0.67 [bos] ! was first in a corner all , ! [unk] and [unk] made -- an bidding all with just . [eos] cls2 - sp3 : -45.56 -2.17 22 0.67 [bos] ! was first in a corner all , ! [unk] and [unk] all -- an bidding all with just . [eos] cls2 - sp4 : -45.56 -2.17 22 0.67 [bos] ! was editor in a telephone all , ! [unk] and [unk] made -- an bidding all with just . [eos] cls3 - sp0 : -33.01 -1.57 22 1.00 [bos] ! was corner in a telephone all , ! [unk] and [unk] made -- an telephone all with state . [eos] cls3 - sp1 : -33.04 -1.57 22 1.00 [bos] ! was corner in a telephone all , ! [unk] and [unk] made -- an telephone all with just . [eos] cls3 - sp2 : -33.05 -1.57 22 1.00 [bos] ! was corner in a housing all , ! [unk] and [unk] made -- an telephone all with state . [eos] cls3 - sp3 : -33.12 -1.58 22 1.00 [bos] ! was corner in a housing all , ! [unk] and [unk] made -- an telephone all with just . [eos] cls3 - sp4 : -33.21 -1.58 22 1.00 [bos] ! was telephone in a housing all , ! [unk] and [unk] made -- an telephone all with state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-383 src: none none 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt0: mod/noi/dif/loss/nce/logp -73.07 /-2.29 /-70.78 /0.69/-0.69 -3.48 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt1: mod/noi/dif/loss/nce/logp -73.07 /-2.29 /-70.78 / /-0.69 -3.48 /-0.11 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] tgt2: mod/noi/dif/loss/nce/logp -114.12/-13.18 /-100.95/ /-30.85 -5.71 /-0.66 21 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children [eos] tgt3: mod/noi/dif/loss/nce/logp -92.97 /-12.72 /-80.24 / /-10.15 -4.43 /-0.61 22 [bos] this was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way [unk] children . [eos] tgt4: mod/noi/dif/loss/nce/logp -162.01/-12.32 /-149.69/ /-79.60 -81.00/-6.16 3 [bos] this [eos] tgt5: mod/noi/dif/loss/nce/logp -93.28 /-13.11 /-80.16 / /-10.07 -4.44 /-0.62 22 [bos] the was delivered in a forthright way , without [unk] and [unk] interest -- an admirable way with children . [eos] cls0 - sp0 : -33.20 -1.58 22 0.05 [bos] ! was couldn't in a joined all , later [unk] and [unk] all -- an cleaning all with into . [eos] cls0 - sp1 : -33.33 -1.59 22 0.05 [bos] ! was couldn't in a streets all , later [unk] and [unk] all -- an cleaning all with into . [eos] cls0 - sp2 : -33.42 -1.59 22 0.05 [bos] ! was couldn't in a joined all , later [unk] and [unk] first -- an cleaning all with into . [eos] cls0 - sp3 : -35.00 -1.75 21 0.05 [bos] ! was couldn't in a joined all , ! [unk] and [unk] all -- an cleaning all with . [eos] cls0 - sp4 : -35.23 -1.76 21 0.05 [bos] ! was couldn't in a streets all , later [unk] and [unk] first -- an cleaning all with . [eos] cls1 - sp0 : -36.07 -2.00 19 0.28 [bos] ! was telephone in a joined all , ! [unk] and [unk] she -- an cleaning ! [eos] cls1 - sp1 : -40.30 -2.01 21 0.25 [bos] ! was telephone in a wherever all , ! [unk] and [unk] she -- an cleaning all with . [eos] cls1 - sp2 : -40.57 -2.03 21 0.25 [bos] ! was telephone in a streets all , ! [unk] and [unk] she -- an cleaning all with . [eos] cls1 - sp3 : -40.86 -2.04 21 0.25 [bos] ! was telephone in a streets all , ! [unk] and [unk] don't -- an cleaning all with . [eos] cls1 - sp4 : -40.94 -2.05 21 0.25 [bos] ! was telephone in a cleaning all , ! [unk] and [unk] she -- an cleaning all with . [eos] cls2 - sp0 : -45.41 -2.16 22 0.67 [bos] ! was editor in a corner all , ! [unk] and [unk] made -- an bidding all with just . [eos] cls2 - sp1 : -45.44 -2.16 22 0.67 [bos] ! was editor in a corner all , ! [unk] and [unk] all -- an bidding all with just . [eos] cls2 - sp2 : -45.53 -2.17 22 0.67 [bos] ! was first in a corner all , ! [unk] and [unk] made -- an bidding all with just . [eos] cls2 - sp3 : -45.56 -2.17 22 0.67 [bos] ! was first in a corner all , ! [unk] and [unk] all -- an bidding all with just . [eos] cls2 - sp4 : -45.56 -2.17 22 0.67 [bos] ! was editor in a telephone all , ! [unk] and [unk] made -- an bidding all with just . [eos] cls3 - sp0 : -33.01 -1.57 22 1.00 [bos] ! was corner in a telephone all , ! [unk] and [unk] made -- an telephone all with state . [eos] cls3 - sp1 : -33.04 -1.57 22 1.00 [bos] ! was corner in a telephone all , ! [unk] and [unk] made -- an telephone all with just . [eos] cls3 - sp2 : -33.05 -1.57 22 1.00 [bos] ! was corner in a housing all , ! [unk] and [unk] made -- an telephone all with state . [eos] cls3 - sp3 : -33.12 -1.58 22 1.00 [bos] ! was corner in a housing all , ! [unk] and [unk] made -- an telephone all with just . [eos] cls3 - sp4 : -33.21 -1.58 22 1.00 [bos] ! was telephone in a housing all , ! [unk] and [unk] made -- an telephone all with state . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-384 src: none none 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.36 /-0.78 /-50.58 /14.82/-14.82 -6.42 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.36 /-0.78 /-50.58 / /-14.82 -6.42 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt2: mod/noi/dif/loss/nce/logp -81.86 /-11.66 /-70.20 / /-34.43 -11.69/-1.67 8 [bos] my uncle looked at mr. gorboduc [eos] tgt3: mod/noi/dif/loss/nce/logp -48.82 /-13.06 /-35.76 / /-0.00 -6.10 /-1.63 9 [bos] my uncle looked at mr. ascertain . [eos] tgt4: mod/noi/dif/loss/nce/logp -87.86 /-11.95 /-75.91 / /-40.15 -9.76 /-1.33 10 [bos] my uncle looked at mr. gorboduc . . [eos] tgt5: mod/noi/dif/loss/nce/logp -75.16 /-12.23 /-62.94 / /-27.17 -9.40 /-1.53 9 [bos] my uncle looked at mr. gorboduc , [eos] cls0 - sp0 : -12.87 -1.61 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp1 : -13.29 -1.66 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp2 : -13.36 -1.67 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp3 : -13.48 -1.68 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp4 : -13.49 -1.69 9 0.12 [bos] ! ! ! at ! ! . [eos] cls1 - sp0 : -11.50 -1.44 9 0.38 [bos] ! ! ! at ! ! . [eos] cls1 - sp1 : -12.27 -1.53 9 0.25 [bos] ! ! ! at ! ! . [eos] cls1 - sp2 : -12.39 -1.55 9 0.25 [bos] ! ! ! at ! ! . [eos] cls1 - sp3 : -12.44 -1.55 9 0.25 [bos] ! ! ! at ! ! . [eos] cls1 - sp4 : -12.47 -1.56 9 0.25 [bos] ! ! ! at ! ! . [eos] cls2 - sp0 : -9.56 -1.20 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp1 : -10.11 -1.26 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp2 : -10.36 -1.29 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp3 : -10.49 -1.31 9 0.50 [bos] ! ! ! at ! ! . [eos] cls2 - sp4 : -10.78 -1.35 9 0.62 [bos] ! ! ! ; ! ! . [eos] cls3 - sp0 : -9.07 -1.13 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp1 : -9.30 -1.16 9 0.88 [bos] ! ! ! at ! ! . [eos] cls3 - sp2 : -10.53 -1.32 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp3 : -10.87 -1.36 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp4 : -11.19 -1.40 9 0.75 [bos] ! ! ! ; ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-385 src: none none 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt0: mod/noi/dif/loss/nce/logp -57.07 /-0.78 /-56.29 /11.41/-11.41 -7.13 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt1: mod/noi/dif/loss/nce/logp -57.07 /-0.78 /-56.29 / /-11.41 -7.13 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt2: mod/noi/dif/loss/nce/logp -89.08 /-11.66 /-77.41 / /-32.53 -12.73/-1.67 8 [bos] my uncle looked at mr. gorboduc [eos] tgt3: mod/noi/dif/loss/nce/logp -57.94 /-13.06 /-44.88 / /-0.00 -7.24 /-1.63 9 [bos] my uncle looked at mr. ascertain . [eos] tgt4: mod/noi/dif/loss/nce/logp -95.32 /-11.95 /-83.37 / /-38.49 -10.59/-1.33 10 [bos] my uncle looked at mr. gorboduc . . [eos] tgt5: mod/noi/dif/loss/nce/logp -76.71 /-12.23 /-64.49 / /-19.61 -9.59 /-1.53 9 [bos] my uncle looked at mr. gorboduc , [eos] cls0 - sp0 : -12.87 -1.61 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp1 : -13.29 -1.66 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp2 : -13.36 -1.67 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp3 : -13.48 -1.68 9 0.12 [bos] ! ! ! at ! ! . [eos] cls0 - sp4 : -13.49 -1.69 9 0.12 [bos] ! ! ! at ! ! . [eos] cls1 - sp0 : -11.50 -1.44 9 0.38 [bos] ! ! ! at ! ! . [eos] cls1 - sp1 : -12.27 -1.53 9 0.25 [bos] ! ! ! at ! ! . [eos] cls1 - sp2 : -12.39 -1.55 9 0.25 [bos] ! ! ! at ! ! . [eos] cls1 - sp3 : -12.44 -1.55 9 0.25 [bos] ! ! ! at ! ! . [eos] cls1 - sp4 : -12.47 -1.56 9 0.25 [bos] ! ! ! at ! ! . [eos] cls2 - sp0 : -9.56 -1.20 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp1 : -10.11 -1.26 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp2 : -10.36 -1.29 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp3 : -10.49 -1.31 9 0.50 [bos] ! ! ! at ! ! . [eos] cls2 - sp4 : -10.78 -1.35 9 0.62 [bos] ! ! ! ; ! ! . [eos] cls3 - sp0 : -9.07 -1.13 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp1 : -9.30 -1.16 9 0.88 [bos] ! ! ! at ! ! . [eos] cls3 - sp2 : -10.53 -1.32 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp3 : -10.87 -1.36 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp4 : -11.19 -1.40 9 0.75 [bos] ! ! ! ; ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-386 src: none none 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt0: mod/noi/dif/loss/nce/logp -51.95 /-0.78 /-51.17 /14.95/-14.95 -6.49 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt1: mod/noi/dif/loss/nce/logp -51.95 /-0.78 /-51.17 / /-14.95 -6.49 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt2: mod/noi/dif/loss/nce/logp -83.57 /-11.66 /-71.91 / /-35.69 -11.94/-1.67 8 [bos] my uncle looked at mr. gorboduc [eos] tgt3: mod/noi/dif/loss/nce/logp -49.28 /-13.06 /-36.22 / /-0.00 -6.16 /-1.63 9 [bos] my uncle looked at mr. ascertain . [eos] tgt4: mod/noi/dif/loss/nce/logp -86.59 /-11.95 /-74.64 / /-38.42 -9.62 /-1.33 10 [bos] my uncle looked at mr. gorboduc . . [eos] tgt5: mod/noi/dif/loss/nce/logp -74.77 /-12.23 /-62.54 / /-26.33 -9.35 /-1.53 9 [bos] my uncle looked at mr. gorboduc , [eos] cls0 - sp0 : -10.65 -2.13 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.48 -2.30 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -11.85 -2.37 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp3 : -12.92 -2.58 6 0.20 [bos] ! ! ! ; [eos] cls0 - sp4 : -14.13 -1.77 9 0.12 [bos] ! ! ! or ! ! . [eos] cls1 - sp0 : -9.95 -1.99 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.60 -2.32 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.85 -2.37 6 0.40 [bos] ! ! ! ; [eos] cls1 - sp3 : -12.24 -2.45 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -12.91 -1.61 9 0.38 [bos] ! ! ! or ! ! . [eos] cls2 - sp0 : -9.93 -1.99 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -10.19 -2.04 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.38 -2.28 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -11.49 -1.44 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp4 : -12.18 -1.52 9 0.62 [bos] ! ! ! or ! ! . [eos] cls3 - sp0 : -9.78 -1.96 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -10.07 -2.01 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -10.73 -2.15 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -11.23 -1.40 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp4 : -11.78 -1.47 9 0.75 [bos] ! ! ! ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-387 src: none none 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt0: mod/noi/dif/loss/nce/logp -56.07 /-0.78 /-55.30 /11.96/-11.96 -7.01 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt1: mod/noi/dif/loss/nce/logp -56.07 /-0.78 /-55.30 / /-11.96 -7.01 /-0.10 9 [bos] my uncle looked at mr. gorboduc . [eos] tgt2: mod/noi/dif/loss/nce/logp -89.32 /-11.66 /-77.65 / /-34.32 -12.76/-1.67 8 [bos] my uncle looked at mr. gorboduc [eos] tgt3: mod/noi/dif/loss/nce/logp -56.39 /-13.06 /-43.33 / /-0.00 -7.05 /-1.63 9 [bos] my uncle looked at mr. ascertain . [eos] tgt4: mod/noi/dif/loss/nce/logp -92.99 /-11.95 /-81.04 / /-37.71 -10.33/-1.33 10 [bos] my uncle looked at mr. gorboduc . . [eos] tgt5: mod/noi/dif/loss/nce/logp -74.83 /-12.23 /-62.60 / /-19.27 -9.35 /-1.53 9 [bos] my uncle looked at mr. gorboduc , [eos] cls0 - sp0 : -10.65 -2.13 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp1 : -11.48 -2.30 6 0.20 [bos] ! ! ! ! [eos] cls0 - sp2 : -11.85 -2.37 6 0.00 [bos] ! ! ! ! [eos] cls0 - sp3 : -12.92 -2.58 6 0.20 [bos] ! ! ! ; [eos] cls0 - sp4 : -14.13 -1.77 9 0.12 [bos] ! ! ! or ! ! . [eos] cls1 - sp0 : -9.95 -1.99 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp1 : -11.60 -2.32 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp2 : -11.85 -2.37 6 0.40 [bos] ! ! ! ; [eos] cls1 - sp3 : -12.24 -2.45 6 0.40 [bos] ! ! ! ! [eos] cls1 - sp4 : -12.91 -1.61 9 0.38 [bos] ! ! ! or ! ! . [eos] cls2 - sp0 : -9.93 -1.99 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp1 : -10.19 -2.04 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp2 : -11.38 -2.28 6 0.60 [bos] ! ! ! ! [eos] cls2 - sp3 : -11.49 -1.44 9 0.62 [bos] ! ! ! at ! ! . [eos] cls2 - sp4 : -12.18 -1.52 9 0.62 [bos] ! ! ! or ! ! . [eos] cls3 - sp0 : -9.78 -1.96 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp1 : -10.07 -2.01 6 1.00 [bos] ! ! ! ! [eos] cls3 - sp2 : -10.73 -2.15 6 0.80 [bos] ! ! ! ! [eos] cls3 - sp3 : -11.23 -1.40 9 0.75 [bos] ! ! ! at ! ! . [eos] cls3 - sp4 : -11.78 -1.47 9 0.75 [bos] ! ! ! ! ! ! . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-388 src: none none 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -95.25 /-2.03 /-93.22 /0.69/-0.69 -4.76 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -95.25 /-2.03 /-93.22 / /-0.69 -4.76 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -115.45/-12.46 /-102.99/ /-10.46 -5.77 /-0.62 21 [bos] the champs [unk] is literally littered this summer [unk] the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -232.92/-11.35 /-221.56/ /-129.03 -58.23/-2.84 5 [bos] the champs [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -115.94/-12.62 /-103.31/ /-10.78 -5.80 /-0.63 21 [bos] the champs [unk] is literally littered this summer of the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -114.62/-12.77 /-101.85/ /-9.31 -5.73 /-0.64 21 [bos] the champs [unk] is literally littered the summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] cls0 - sp0 : -38.54 -1.93 21 0.00 [bos] : couldn't [unk] is crashed editor this united with the [unk] deck of organized [unk] streets [unk] [unk] . [eos] cls0 - sp1 : -38.62 -1.93 21 0.00 [bos] : couldn't [unk] is expecting editor this united with the [unk] deck of organized [unk] streets [unk] [unk] . [eos] cls0 - sp2 : -38.64 -1.93 21 0.00 [bos] : couldn't [unk] is crashed editor this united with the [unk] cleaning of organized [unk] streets [unk] [unk] . [eos] cls0 - sp3 : -38.70 -1.94 21 0.00 [bos] : couldn't [unk] is expecting cleaning this united with the [unk] deck of organized [unk] streets [unk] [unk] . [eos] cls0 - sp4 : -38.75 -1.94 21 0.00 [bos] : couldn't [unk] is expecting editor this united with the [unk] cleaning of organized [unk] streets [unk] [unk] . [eos] cls1 - sp0 : -41.76 -2.09 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] bidding of telephone [unk] streets [unk] [unk] . [eos] cls1 - sp1 : -41.90 -2.10 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] bidding of telephone [unk] editor [unk] [unk] . [eos] cls1 - sp2 : -42.04 -2.10 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] bidding of telephone [unk] organized [unk] [unk] . [eos] cls1 - sp3 : -42.04 -2.10 21 0.25 [bos] : most [unk] is tips telephone this firms with the [unk] bidding of telephone [unk] streets [unk] [unk] . [eos] cls1 - sp4 : -42.14 -2.11 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] cleaning of telephone [unk] streets [unk] [unk] . [eos] cls2 - sp0 : -44.91 -2.25 21 0.70 [bos] : most [unk] is flung telephone this ! with the [unk] telephone of telephone [unk] bidding [unk] [unk] . [eos] cls2 - sp1 : -45.04 -2.25 21 0.70 [bos] : most [unk] is flung telephone this firms with the [unk] telephone of telephone [unk] bidding [unk] [unk] . [eos] cls2 - sp2 : -46.81 -2.34 21 0.70 [bos] : most [unk] is flung telephone this ! with the [unk] telephone of telephone [unk] laughed [unk] [unk] . [eos] cls2 - sp3 : -46.89 -2.34 21 0.70 [bos] : most [unk] is flung telephone this ! with the [unk] telephone of telephone [unk] receiving [unk] [unk] . [eos] cls2 - sp4 : -47.03 -2.35 21 0.70 [bos] : most [unk] is flung telephone this firms with the [unk] telephone of telephone [unk] laughed [unk] [unk] . [eos] cls3 - sp0 : -39.06 -1.95 21 1.00 [bos] she corner [unk] is flung telephone this much with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp1 : -39.20 -1.96 21 1.00 [bos] she corner [unk] is flung telephone this much with the [unk] crime of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp2 : -39.24 -1.96 21 1.00 [bos] she corner [unk] is flung telephone this much with the [unk] telephone of corner [unk] telephone [unk] [unk] . [eos] cls3 - sp3 : -39.32 -1.97 21 1.00 [bos] she corner [unk] is telephone telephone this much with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp4 : -39.53 -1.98 21 1.00 [bos] she almost [unk] is crime telephone this much with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-389 src: none none 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -97.46 /-2.03 /-95.43 /0.69/-0.69 -4.87 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -97.46 /-2.03 /-95.43 / /-0.69 -4.87 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -117.23/-12.46 /-104.76/ /-10.03 -5.86 /-0.62 21 [bos] the champs [unk] is literally littered this summer [unk] the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -235.11/-11.35 /-223.75/ /-129.02 -58.78/-2.84 5 [bos] the champs [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -118.65/-12.62 /-106.02/ /-11.29 -5.93 /-0.63 21 [bos] the champs [unk] is literally littered this summer of the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -117.67/-12.77 /-104.90/ /-10.16 -5.88 /-0.64 21 [bos] the champs [unk] is literally littered the summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] cls0 - sp0 : -38.54 -1.93 21 0.00 [bos] : couldn't [unk] is crashed editor this united with the [unk] deck of organized [unk] streets [unk] [unk] . [eos] cls0 - sp1 : -38.62 -1.93 21 0.00 [bos] : couldn't [unk] is expecting editor this united with the [unk] deck of organized [unk] streets [unk] [unk] . [eos] cls0 - sp2 : -38.64 -1.93 21 0.00 [bos] : couldn't [unk] is crashed editor this united with the [unk] cleaning of organized [unk] streets [unk] [unk] . [eos] cls0 - sp3 : -38.70 -1.94 21 0.00 [bos] : couldn't [unk] is expecting cleaning this united with the [unk] deck of organized [unk] streets [unk] [unk] . [eos] cls0 - sp4 : -38.75 -1.94 21 0.00 [bos] : couldn't [unk] is expecting editor this united with the [unk] cleaning of organized [unk] streets [unk] [unk] . [eos] cls1 - sp0 : -41.76 -2.09 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] bidding of telephone [unk] streets [unk] [unk] . [eos] cls1 - sp1 : -41.90 -2.10 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] bidding of telephone [unk] editor [unk] [unk] . [eos] cls1 - sp2 : -42.04 -2.10 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] bidding of telephone [unk] organized [unk] [unk] . [eos] cls1 - sp3 : -42.04 -2.10 21 0.25 [bos] : most [unk] is tips telephone this firms with the [unk] bidding of telephone [unk] streets [unk] [unk] . [eos] cls1 - sp4 : -42.14 -2.11 21 0.25 [bos] : most [unk] is flung telephone this firms with the [unk] cleaning of telephone [unk] streets [unk] [unk] . [eos] cls2 - sp0 : -44.91 -2.25 21 0.70 [bos] : most [unk] is flung telephone this ! with the [unk] telephone of telephone [unk] bidding [unk] [unk] . [eos] cls2 - sp1 : -45.04 -2.25 21 0.70 [bos] : most [unk] is flung telephone this firms with the [unk] telephone of telephone [unk] bidding [unk] [unk] . [eos] cls2 - sp2 : -46.81 -2.34 21 0.70 [bos] : most [unk] is flung telephone this ! with the [unk] telephone of telephone [unk] laughed [unk] [unk] . [eos] cls2 - sp3 : -46.89 -2.34 21 0.70 [bos] : most [unk] is flung telephone this ! with the [unk] telephone of telephone [unk] receiving [unk] [unk] . [eos] cls2 - sp4 : -47.03 -2.35 21 0.70 [bos] : most [unk] is flung telephone this firms with the [unk] telephone of telephone [unk] laughed [unk] [unk] . [eos] cls3 - sp0 : -39.06 -1.95 21 1.00 [bos] she corner [unk] is flung telephone this much with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp1 : -39.20 -1.96 21 1.00 [bos] she corner [unk] is flung telephone this much with the [unk] crime of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp2 : -39.24 -1.96 21 1.00 [bos] she corner [unk] is flung telephone this much with the [unk] telephone of corner [unk] telephone [unk] [unk] . [eos] cls3 - sp3 : -39.32 -1.97 21 1.00 [bos] she corner [unk] is telephone telephone this much with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp4 : -39.53 -1.98 21 1.00 [bos] she almost [unk] is crime telephone this much with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-390 src: none none 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -98.12 /-2.03 /-96.09 /0.69/-0.69 -4.91 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -98.12 /-2.03 /-96.09 / /-0.69 -4.91 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -117.76/-12.46 /-105.30/ /-9.90 -5.89 /-0.62 21 [bos] the champs [unk] is literally littered this summer [unk] the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -199.49/-11.35 /-188.13/ /-92.74 -49.87/-2.84 5 [bos] the champs [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -117.49/-12.62 /-104.87/ /-9.47 -5.87 /-0.63 21 [bos] the champs [unk] is literally littered this summer of the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -118.13/-12.77 /-105.35/ /-9.96 -5.91 /-0.64 21 [bos] the champs [unk] is literally littered the summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] cls0 - sp0 : -35.82 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning joined this i with the [unk] i of joined [unk] she [unk] [unk] . [eos] cls0 - sp1 : -35.84 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning joined this i with the [unk] i of joined [unk] joined [unk] [unk] . [eos] cls0 - sp2 : -35.85 -1.79 21 0.00 [bos] : couldn't [unk] is expecting joined this i with the [unk] i of joined [unk] she [unk] [unk] . [eos] cls0 - sp3 : -35.86 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning couldn't this i with the [unk] i of joined [unk] joined [unk] [unk] . [eos] cls0 - sp4 : -35.86 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning joined this i with the [unk] i of editor [unk] she [unk] [unk] . [eos] cls1 - sp0 : -41.66 -2.08 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of pain [unk] joined [unk] [unk] . [eos] cls1 - sp1 : -41.75 -2.09 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of editor [unk] joined [unk] [unk] . [eos] cls1 - sp2 : -41.81 -2.09 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of editor [unk] she [unk] [unk] . [eos] cls1 - sp3 : -41.82 -2.09 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of pain [unk] she [unk] [unk] . [eos] cls1 - sp4 : -41.95 -2.10 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of joined [unk] joined [unk] [unk] . [eos] cls2 - sp0 : -39.20 -1.96 21 0.50 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of corner [unk] she [unk] [unk] . [eos] cls2 - sp1 : -39.63 -1.98 21 0.70 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls2 - sp2 : -39.80 -1.99 21 0.70 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls2 - sp3 : -39.95 -2.00 21 0.60 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls2 - sp4 : -40.53 -2.03 21 0.70 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls3 - sp0 : -34.96 -1.75 21 1.00 [bos] she corner [unk] is crime corner this ! with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp1 : -34.97 -1.75 21 1.00 [bos] she corner [unk] is crime corner this ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls3 - sp2 : -35.03 -1.75 21 1.00 [bos] she corner [unk] is streets corner this ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls3 - sp3 : -35.06 -1.75 21 1.00 [bos] she corner [unk] is streets corner this ! with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp4 : -35.08 -1.75 21 1.00 [bos] she corner [unk] is crime telephone this later with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-391 src: none none 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt0: mod/noi/dif/loss/nce/logp -99.94 /-2.03 /-97.92 /0.69/-0.69 -5.00 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt1: mod/noi/dif/loss/nce/logp -99.94 /-2.03 /-97.92 / /-0.69 -5.00 /-0.10 21 [bos] the champs [unk] is literally littered this summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt2: mod/noi/dif/loss/nce/logp -119.31/-12.46 /-106.85/ /-9.62 -5.97 /-0.62 21 [bos] the champs [unk] is literally littered this summer [unk] the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt3: mod/noi/dif/loss/nce/logp -203.49/-11.35 /-192.14/ /-94.92 -50.87/-2.84 5 [bos] the champs [unk] [eos] tgt4: mod/noi/dif/loss/nce/logp -119.76/-12.62 /-107.13/ /-9.91 -5.99 /-0.63 21 [bos] the champs [unk] is literally littered this summer of the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -120.86/-12.77 /-108.08/ /-10.86 -6.04 /-0.64 21 [bos] the champs [unk] is literally littered the summer with the [unk] bodies of france's [unk] beatnik [unk] [unk] . [eos] cls0 - sp0 : -35.82 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning joined this i with the [unk] i of joined [unk] she [unk] [unk] . [eos] cls0 - sp1 : -35.84 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning joined this i with the [unk] i of joined [unk] joined [unk] [unk] . [eos] cls0 - sp2 : -35.85 -1.79 21 0.00 [bos] : couldn't [unk] is expecting joined this i with the [unk] i of joined [unk] she [unk] [unk] . [eos] cls0 - sp3 : -35.86 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning couldn't this i with the [unk] i of joined [unk] joined [unk] [unk] . [eos] cls0 - sp4 : -35.86 -1.79 21 0.00 [bos] : couldn't [unk] is cleaning joined this i with the [unk] i of editor [unk] she [unk] [unk] . [eos] cls1 - sp0 : -41.66 -2.08 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of pain [unk] joined [unk] [unk] . [eos] cls1 - sp1 : -41.75 -2.09 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of editor [unk] joined [unk] [unk] . [eos] cls1 - sp2 : -41.81 -2.09 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of editor [unk] she [unk] [unk] . [eos] cls1 - sp3 : -41.82 -2.09 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of pain [unk] she [unk] [unk] . [eos] cls1 - sp4 : -41.95 -2.10 21 0.25 [bos] she corner [unk] is telephone couldn't this i with the [unk] i of joined [unk] joined [unk] [unk] . [eos] cls2 - sp0 : -39.20 -1.96 21 0.50 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of corner [unk] she [unk] [unk] . [eos] cls2 - sp1 : -39.63 -1.98 21 0.70 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls2 - sp2 : -39.80 -1.99 21 0.70 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls2 - sp3 : -39.95 -2.00 21 0.60 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls2 - sp4 : -40.53 -2.03 21 0.70 [bos] she corner [unk] is telephone couldn't ! ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls3 - sp0 : -34.96 -1.75 21 1.00 [bos] she corner [unk] is crime corner this ! with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp1 : -34.97 -1.75 21 1.00 [bos] she corner [unk] is crime corner this ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls3 - sp2 : -35.03 -1.75 21 1.00 [bos] she corner [unk] is streets corner this ! with the [unk] telephone of telephone [unk] discussed [unk] [unk] . [eos] cls3 - sp3 : -35.06 -1.75 21 1.00 [bos] she corner [unk] is streets corner this ! with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] cls3 - sp4 : -35.08 -1.75 21 1.00 [bos] she corner [unk] is crime telephone this later with the [unk] telephone of telephone [unk] telephone [unk] [unk] . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-392 src: none none 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt0: mod/noi/dif/loss/nce/logp -64.43 /-2.24 /-62.19 /0.69/-0.69 -3.22 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt1: mod/noi/dif/loss/nce/logp -64.43 /-2.24 /-62.19 / /-0.69 -3.22 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt2: mod/noi/dif/loss/nce/logp -87.18 /-13.37 /-73.81 / /-12.31 -4.36 /-0.67 21 [bos] after the while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt3: mod/noi/dif/loss/nce/logp -85.30 /-13.06 /-72.23 / /-10.73 -4.26 /-0.65 21 [bos] after a while , we became aware that the money was disappearing as fast as [unk] [unk] it . [eos] tgt4: mod/noi/dif/loss/nce/logp -105.24/-13.18 /-92.06 / /-30.56 -5.54 /-0.69 20 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it [eos] tgt5: mod/noi/dif/loss/nce/logp -86.27 /-13.06 /-73.21 / /-11.70 -4.31 /-0.65 21 [bos] after a while , [unk] became aware that the money was disappearing as fast as we [unk] it . [eos] cls0 - sp0 : -28.06 -1.40 21 0.00 [bos] i a any , we this streets that the ! was cleaning as no as we [unk] it . [eos] cls0 - sp1 : -28.16 -1.41 21 0.00 [bos] i a any , we this streets that the ! was editor as no as we [unk] it . [eos] cls0 - sp2 : -28.18 -1.41 21 0.00 [bos] i a this , we this streets that the ! was cleaning as no as we [unk] it . [eos] cls0 - sp3 : -28.19 -1.41 21 0.00 [bos] i a has , we this streets that the ! was cleaning as no as we [unk] it . [eos] cls0 - sp4 : -28.25 -1.41 21 0.00 [bos] i a any , we this streets that the ! was cleaning as ! as we [unk] it . [eos] cls1 - sp0 : -28.15 -1.41 21 0.25 [bos] ! a later , we this `` that the ! was cleaning as ! as we [unk] it . [eos] cls1 - sp1 : -28.16 -1.41 21 0.25 [bos] ! a later , we this `` that the ! was editor as ! as we [unk] it . [eos] cls1 - sp2 : -28.49 -1.42 21 0.25 [bos] ! a later , we this `` that the ! was patience as ! as we [unk] it . [eos] cls1 - sp3 : -28.69 -1.43 21 0.25 [bos] ! a later , we i `` that the ! was cleaning as ! as we [unk] it . [eos] cls1 - sp4 : -28.71 -1.44 21 0.25 [bos] ! a later , we i `` that the ! was editor as ! as we [unk] it . [eos] cls2 - sp0 : -32.79 -1.64 21 0.70 [bos] ! a later , we yes `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp1 : -33.00 -1.65 21 0.70 [bos] ! a later , we later `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp2 : -33.66 -1.68 21 0.65 [bos] ! a later , we later `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp3 : -33.73 -1.69 21 0.65 [bos] ! a later , we yes `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp4 : -33.77 -1.69 21 0.50 [bos] ! a later , we later `` that the ! was telephone as ! as we [unk] it . [eos] cls3 - sp0 : -28.54 -1.43 21 1.00 [bos] ! a later , we this `` that the ! was almost as ! as we [unk] it . [eos] cls3 - sp1 : -28.56 -1.43 21 1.00 [bos] ! a later , we this `` all the ! was almost as ! as we [unk] it . [eos] cls3 - sp2 : -28.59 -1.43 21 1.00 [bos] ! a later , we this `` that the ! was almost as no as we [unk] it . [eos] cls3 - sp3 : -28.69 -1.43 21 1.00 [bos] ! a later , we this `` all the ! was almost as no as we [unk] it . [eos] cls3 - sp4 : -28.75 -1.44 21 1.00 [bos] ! a later , we this `` all the ! was streets as ! as we [unk] it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-393 src: none none 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt0: mod/noi/dif/loss/nce/logp -62.10 /-2.24 /-59.86 /0.69/-0.69 -3.11 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt1: mod/noi/dif/loss/nce/logp -62.10 /-2.24 /-59.86 / /-0.69 -3.11 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt2: mod/noi/dif/loss/nce/logp -85.25 /-13.37 /-71.88 / /-12.71 -4.26 /-0.67 21 [bos] after the while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt3: mod/noi/dif/loss/nce/logp -83.07 /-13.06 /-70.01 / /-10.84 -4.15 /-0.65 21 [bos] after a while , we became aware that the money was disappearing as fast as [unk] [unk] it . [eos] tgt4: mod/noi/dif/loss/nce/logp -105.22/-13.18 /-92.04 / /-32.87 -5.54 /-0.69 20 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it [eos] tgt5: mod/noi/dif/loss/nce/logp -83.11 /-13.06 /-70.05 / /-10.88 -4.16 /-0.65 21 [bos] after a while , [unk] became aware that the money was disappearing as fast as we [unk] it . [eos] cls0 - sp0 : -28.06 -1.40 21 0.00 [bos] i a any , we this streets that the ! was cleaning as no as we [unk] it . [eos] cls0 - sp1 : -28.16 -1.41 21 0.00 [bos] i a any , we this streets that the ! was editor as no as we [unk] it . [eos] cls0 - sp2 : -28.18 -1.41 21 0.00 [bos] i a this , we this streets that the ! was cleaning as no as we [unk] it . [eos] cls0 - sp3 : -28.19 -1.41 21 0.00 [bos] i a has , we this streets that the ! was cleaning as no as we [unk] it . [eos] cls0 - sp4 : -28.25 -1.41 21 0.00 [bos] i a any , we this streets that the ! was cleaning as ! as we [unk] it . [eos] cls1 - sp0 : -28.15 -1.41 21 0.25 [bos] ! a later , we this `` that the ! was cleaning as ! as we [unk] it . [eos] cls1 - sp1 : -28.16 -1.41 21 0.25 [bos] ! a later , we this `` that the ! was editor as ! as we [unk] it . [eos] cls1 - sp2 : -28.49 -1.42 21 0.25 [bos] ! a later , we this `` that the ! was patience as ! as we [unk] it . [eos] cls1 - sp3 : -28.69 -1.43 21 0.25 [bos] ! a later , we i `` that the ! was cleaning as ! as we [unk] it . [eos] cls1 - sp4 : -28.71 -1.44 21 0.25 [bos] ! a later , we i `` that the ! was editor as ! as we [unk] it . [eos] cls2 - sp0 : -32.79 -1.64 21 0.70 [bos] ! a later , we yes `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp1 : -33.00 -1.65 21 0.70 [bos] ! a later , we later `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp2 : -33.66 -1.68 21 0.65 [bos] ! a later , we later `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp3 : -33.73 -1.69 21 0.65 [bos] ! a later , we yes `` that the ! was telephone as ! as we [unk] it . [eos] cls2 - sp4 : -33.77 -1.69 21 0.50 [bos] ! a later , we later `` that the ! was telephone as ! as we [unk] it . [eos] cls3 - sp0 : -28.54 -1.43 21 1.00 [bos] ! a later , we this `` that the ! was almost as ! as we [unk] it . [eos] cls3 - sp1 : -28.56 -1.43 21 1.00 [bos] ! a later , we this `` all the ! was almost as ! as we [unk] it . [eos] cls3 - sp2 : -28.59 -1.43 21 1.00 [bos] ! a later , we this `` that the ! was almost as no as we [unk] it . [eos] cls3 - sp3 : -28.69 -1.43 21 1.00 [bos] ! a later , we this `` all the ! was almost as no as we [unk] it . [eos] cls3 - sp4 : -28.75 -1.44 21 1.00 [bos] ! a later , we this `` all the ! was streets as ! as we [unk] it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-394 src: none none 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt0: mod/noi/dif/loss/nce/logp -67.98 /-2.24 /-65.74 /0.69/-0.69 -3.40 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt1: mod/noi/dif/loss/nce/logp -67.98 /-2.24 /-65.74 / /-0.69 -3.40 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt2: mod/noi/dif/loss/nce/logp -91.05 /-13.37 /-77.68 / /-12.63 -4.55 /-0.67 21 [bos] after the while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt3: mod/noi/dif/loss/nce/logp -88.52 /-13.06 /-75.46 / /-10.41 -4.43 /-0.65 21 [bos] after a while , we became aware that the money was disappearing as fast as [unk] [unk] it . [eos] tgt4: mod/noi/dif/loss/nce/logp -104.49/-13.18 /-91.31 / /-26.26 -5.50 /-0.69 20 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it [eos] tgt5: mod/noi/dif/loss/nce/logp -89.62 /-13.06 /-76.56 / /-11.51 -4.48 /-0.65 21 [bos] after a while , [unk] became aware that the money was disappearing as fast as we [unk] it . [eos] cls0 - sp0 : -31.99 -1.60 21 0.00 [bos] ( a any , we joined ( that the joined was society as streets as we [unk] it . [eos] cls0 - sp1 : -32.00 -1.60 21 0.00 [bos] ( a any , we joined ( that the joined was society as she as we [unk] it . [eos] cls0 - sp2 : -32.02 -1.60 21 0.00 [bos] ( a any , we later ( that the joined was society as she as we [unk] it . [eos] cls0 - sp3 : -32.02 -1.60 21 0.00 [bos] ( a any , we joined ( that the joined was society as couldn't as we [unk] it . [eos] cls0 - sp4 : -32.02 -1.60 21 0.00 [bos] ( a any , we later ( that the joined was society as streets as we [unk] it . [eos] cls1 - sp0 : -37.80 -1.89 21 0.45 [bos] she a this , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls1 - sp1 : -37.86 -1.89 21 0.45 [bos] all a don't , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls1 - sp2 : -37.87 -1.89 21 0.45 [bos] she a this , we don't `` that the personal was thought as telephone as we [unk] it . [eos] cls1 - sp3 : -40.13 -2.01 21 0.25 [bos] ! a later , we don't `` that the 4 was deck as she as we [unk] it . [eos] cls1 - sp4 : -40.23 -2.01 21 0.25 [bos] ! a later , we don't `` that the 4 was organized as she as we [unk] it . [eos] cls2 - sp0 : -37.21 -1.86 21 0.70 [bos] she a this , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls2 - sp1 : -37.29 -1.86 21 0.70 [bos] all a don't , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls2 - sp2 : -37.33 -1.87 21 0.70 [bos] she a this , we don't `` that the personal was thought as telephone as we [unk] it . [eos] cls2 - sp3 : -37.83 -1.89 21 0.70 [bos] she a this , we don't `` that the personal was sponsored as corner as we [unk] it . [eos] cls2 - sp4 : -38.07 -1.90 21 0.65 [bos] she a this , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls3 - sp0 : -31.24 -1.56 21 1.00 [bos] she a later , we later `` that the personal was state as corner as we [unk] it . [eos] cls3 - sp1 : -31.43 -1.57 21 1.00 [bos] she a later , we later `` that the personal was state as telephone as we [unk] it . [eos] cls3 - sp2 : -31.44 -1.57 21 1.00 [bos] we a later , we later `` that the personal was state as corner as we [unk] it . [eos] cls3 - sp3 : -31.48 -1.57 21 1.00 [bos] ( a later , we later `` that the personal was state as corner as we [unk] it . [eos] cls3 - sp4 : -31.50 -1.57 21 1.00 [bos] she a later , we later `` that the personal was streets as corner as we [unk] it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-395 src: none none 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt0: mod/noi/dif/loss/nce/logp -66.43 /-2.24 /-64.19 /0.69/-0.69 -3.32 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt1: mod/noi/dif/loss/nce/logp -66.43 /-2.24 /-64.19 / /-0.69 -3.32 /-0.11 21 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt2: mod/noi/dif/loss/nce/logp -90.03 /-13.37 /-76.67 / /-13.17 -4.50 /-0.67 21 [bos] after the while , we became aware that the money was disappearing as fast as we [unk] it . [eos] tgt3: mod/noi/dif/loss/nce/logp -87.07 /-13.06 /-74.01 / /-10.51 -4.35 /-0.65 21 [bos] after a while , we became aware that the money was disappearing as fast as [unk] [unk] it . [eos] tgt4: mod/noi/dif/loss/nce/logp -106.22/-13.18 /-93.04 / /-29.54 -5.59 /-0.69 20 [bos] after a while , we became aware that the money was disappearing as fast as we [unk] it [eos] tgt5: mod/noi/dif/loss/nce/logp -87.35 /-13.06 /-74.29 / /-10.79 -4.37 /-0.65 21 [bos] after a while , [unk] became aware that the money was disappearing as fast as we [unk] it . [eos] cls0 - sp0 : -31.99 -1.60 21 0.00 [bos] ( a any , we joined ( that the joined was society as streets as we [unk] it . [eos] cls0 - sp1 : -32.00 -1.60 21 0.00 [bos] ( a any , we joined ( that the joined was society as she as we [unk] it . [eos] cls0 - sp2 : -32.02 -1.60 21 0.00 [bos] ( a any , we later ( that the joined was society as she as we [unk] it . [eos] cls0 - sp3 : -32.02 -1.60 21 0.00 [bos] ( a any , we joined ( that the joined was society as couldn't as we [unk] it . [eos] cls0 - sp4 : -32.02 -1.60 21 0.00 [bos] ( a any , we later ( that the joined was society as streets as we [unk] it . [eos] cls1 - sp0 : -37.80 -1.89 21 0.45 [bos] she a this , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls1 - sp1 : -37.86 -1.89 21 0.45 [bos] all a don't , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls1 - sp2 : -37.87 -1.89 21 0.45 [bos] she a this , we don't `` that the personal was thought as telephone as we [unk] it . [eos] cls1 - sp3 : -40.13 -2.01 21 0.25 [bos] ! a later , we don't `` that the 4 was deck as she as we [unk] it . [eos] cls1 - sp4 : -40.23 -2.01 21 0.25 [bos] ! a later , we don't `` that the 4 was organized as she as we [unk] it . [eos] cls2 - sp0 : -37.21 -1.86 21 0.70 [bos] she a this , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls2 - sp1 : -37.29 -1.86 21 0.70 [bos] all a don't , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls2 - sp2 : -37.33 -1.87 21 0.70 [bos] she a this , we don't `` that the personal was thought as telephone as we [unk] it . [eos] cls2 - sp3 : -37.83 -1.89 21 0.70 [bos] she a this , we don't `` that the personal was sponsored as corner as we [unk] it . [eos] cls2 - sp4 : -38.07 -1.90 21 0.65 [bos] she a this , we don't `` that the personal was crime as telephone as we [unk] it . [eos] cls3 - sp0 : -31.24 -1.56 21 1.00 [bos] she a later , we later `` that the personal was state as corner as we [unk] it . [eos] cls3 - sp1 : -31.43 -1.57 21 1.00 [bos] she a later , we later `` that the personal was state as telephone as we [unk] it . [eos] cls3 - sp2 : -31.44 -1.57 21 1.00 [bos] we a later , we later `` that the personal was state as corner as we [unk] it . [eos] cls3 - sp3 : -31.48 -1.57 21 1.00 [bos] ( a later , we later `` that the personal was state as corner as we [unk] it . [eos] cls3 - sp4 : -31.50 -1.57 21 1.00 [bos] she a later , we later `` that the personal was streets as corner as we [unk] it . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-396 src: none none 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt0: mod/noi/dif/loss/nce/logp -216.99/-5.14 /-211.85/12.12/-12.12 -4.34 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt1: mod/noi/dif/loss/nce/logp -216.99/-5.14 /-211.85/ /-12.12 -4.34 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt2: mod/noi/dif/loss/nce/logp -414.75/-13.96 /-400.79/ /-201.06 -16.59/-0.56 26 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt . [eos] tgt3: mod/noi/dif/loss/nce/logp -375.08/-13.32 /-361.76/ /-162.03 -20.84/-0.74 19 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -422.82/-15.57 /-407.25/ /-207.52 -15.10/-0.56 29 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -215.50/-15.77 /-199.73/ /-0.00 -4.31 /-0.32 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you dana expect to be [unk] socially . [eos] cls0 - sp0 : -62.10 -1.77 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , preceding , , the [unk] preceding , preceding [unk] , [unk] , and a society of other [eos] cls0 - sp1 : -62.20 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , preceding , , the [unk] preceding , preceding [unk] , [unk] , and a preceding of other [eos] cls0 - sp2 : -62.29 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , preceding , , the [unk] preceding , preceding [unk] , [unk] , and a shall of other [eos] cls0 - sp3 : -62.41 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , honeymoon , , the [unk] preceding , preceding [unk] , [unk] , and a society of other [eos] cls0 - sp4 : -62.41 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , activity , , the [unk] preceding , preceding [unk] , [unk] , and a society of other [eos] cls1 - sp0 : -83.01 -2.37 36 0.43 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of other [eos] cls1 - sp1 : -83.58 -2.39 36 0.43 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a [unk] of other [eos] cls1 - sp2 : -104.06 -2.42 44 0.40 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of they number of the [unk] running organized , ) [eos] cls1 - sp3 : -104.40 -2.43 44 0.40 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of other number of the [unk] of organized , ) [eos] cls1 - sp4 : -104.40 -2.43 44 0.40 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of other number of the [unk] preceding organized , ) [eos] cls2 - sp0 : -111.86 -2.24 51 0.70 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , church [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] the . [eos] cls2 - sp1 : -111.90 -2.24 51 0.72 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , rhode [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] the . [eos] cls2 - sp2 : -111.97 -2.24 51 0.70 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , church [unk] , [unk] , and a and of were number of the [unk] of streets , ) , state to be [unk] the . [eos] cls2 - sp3 : -112.00 -2.24 51 0.70 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , church [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] people . [eos] cls2 - sp4 : -112.03 -2.24 51 0.72 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , rhode [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] people . [eos] cls3 - sp0 : -106.23 -2.12 51 1.00 [bos] [unk] , were streets and to be [unk] streets crime center , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp1 : -106.25 -2.12 51 1.00 [bos] [unk] , were streets and to be [unk] streets the state , with [unk] , [unk] , center state , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp2 : -106.26 -2.13 51 1.00 [bos] [unk] , were streets and to be [unk] streets the state , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp3 : -106.31 -2.13 51 1.00 [bos] [unk] , were streets and to be [unk] crime crime center , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp4 : -106.32 -2.13 51 1.00 [bos] [unk] , were streets and to be [unk] crime example center , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-397 src: none none 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt0: mod/noi/dif/loss/nce/logp -215.55/-5.14 /-210.40/9.72/-9.72 -4.31 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt1: mod/noi/dif/loss/nce/logp -215.55/-5.14 /-210.40/ /-9.72 -4.31 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt2: mod/noi/dif/loss/nce/logp -406.38/-13.96 /-392.43/ /-191.75 -16.26/-0.56 26 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt . [eos] tgt3: mod/noi/dif/loss/nce/logp -368.38/-13.32 /-355.05/ /-154.37 -20.47/-0.74 19 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -411.10/-15.57 /-395.53/ /-194.85 -14.68/-0.56 29 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -216.45/-15.77 /-200.68/ /-0.00 -4.33 /-0.32 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you dana expect to be [unk] socially . [eos] cls0 - sp0 : -62.10 -1.77 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , preceding , , the [unk] preceding , preceding [unk] , [unk] , and a society of other [eos] cls0 - sp1 : -62.20 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , preceding , , the [unk] preceding , preceding [unk] , [unk] , and a preceding of other [eos] cls0 - sp2 : -62.29 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , preceding , , the [unk] preceding , preceding [unk] , [unk] , and a shall of other [eos] cls0 - sp3 : -62.41 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , honeymoon , , the [unk] preceding , preceding [unk] , [unk] , and a society of other [eos] cls0 - sp4 : -62.41 -1.78 36 0.06 [bos] '' , were were and to be [unk] preceding preceding . is with [unk] , [unk] , activity , , the [unk] preceding , preceding [unk] , [unk] , and a society of other [eos] cls1 - sp0 : -83.01 -2.37 36 0.43 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of other [eos] cls1 - sp1 : -83.58 -2.39 36 0.43 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a [unk] of other [eos] cls1 - sp2 : -104.06 -2.42 44 0.40 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of they number of the [unk] running organized , ) [eos] cls1 - sp3 : -104.40 -2.43 44 0.40 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of other number of the [unk] of organized , ) [eos] cls1 - sp4 : -104.40 -2.43 44 0.40 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , 1961 [unk] , [unk] , and a and of other number of the [unk] preceding organized , ) [eos] cls2 - sp0 : -111.86 -2.24 51 0.70 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , church [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] the . [eos] cls2 - sp1 : -111.90 -2.24 51 0.72 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , rhode [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] the . [eos] cls2 - sp2 : -111.97 -2.24 51 0.70 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , church [unk] , [unk] , and a and of were number of the [unk] of streets , ) , state to be [unk] the . [eos] cls2 - sp3 : -112.00 -2.24 51 0.70 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , church [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] people . [eos] cls2 - sp4 : -112.03 -2.24 51 0.72 [bos] '' , this states within to be [unk] delivering preceding . is with [unk] , [unk] , notte , , the [unk] 2 , rhode [unk] , [unk] , and a and of were number of the [unk] of state , ) , state to be [unk] people . [eos] cls3 - sp0 : -106.23 -2.12 51 1.00 [bos] [unk] , were streets and to be [unk] streets crime center , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp1 : -106.25 -2.12 51 1.00 [bos] [unk] , were streets and to be [unk] streets the state , with [unk] , [unk] , center state , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp2 : -106.26 -2.13 51 1.00 [bos] [unk] , were streets and to be [unk] streets the state , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp3 : -106.31 -2.13 51 1.00 [bos] [unk] , were streets and to be [unk] crime crime center , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] cls3 - sp4 : -106.32 -2.13 51 1.00 [bos] [unk] , were streets and to be [unk] crime example center , with [unk] , [unk] , streets , , the [unk] 2 , example [unk] , [unk] , and a state of other number of the [unk] of state , only streets state to be [unk] people . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-398 src: none none 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt0: mod/noi/dif/loss/nce/logp -205.64/-5.14 /-200.50/12.84/-12.84 -4.11 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt1: mod/noi/dif/loss/nce/logp -205.64/-5.14 /-200.50/ /-12.84 -4.11 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt2: mod/noi/dif/loss/nce/logp -400.16/-13.96 /-386.20/ /-198.55 -16.01/-0.56 26 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt . [eos] tgt3: mod/noi/dif/loss/nce/logp -363.25/-13.32 /-349.92/ /-162.27 -20.18/-0.74 19 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -408.49/-15.57 /-392.92/ /-205.26 -14.59/-0.56 29 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -203.43/-15.77 /-187.66/ /-0.00 -4.07 /-0.32 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you dana expect to be [unk] socially . [eos] cls0 - sp0 : -94.36 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , delivering preceding , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you preceding under to be [unk] government . [eos] cls0 - sp1 : -94.36 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , agree agree , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you preceding under to be [unk] government . [eos] cls0 - sp2 : -94.38 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , delivering preceding , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you ) under to be [unk] government . [eos] cls0 - sp3 : -94.43 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , delivering agree , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you preceding under to be [unk] government . [eos] cls0 - sp4 : -94.46 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , agree agree , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you ) under to be [unk] government . [eos] cls1 - sp0 : -96.30 -2.75 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , unquestionably [unk] , [unk] , and a course of other [eos] cls1 - sp1 : -96.39 -2.75 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , unquestionably [unk] , [unk] , and a preceding of other [eos] cls1 - sp2 : -96.44 -2.76 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , superiors [unk] , [unk] , and a preceding of other [eos] cls1 - sp3 : -96.61 -2.76 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , unquestionably [unk] , [unk] , and a different of other [eos] cls1 - sp4 : -96.64 -2.76 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , superiors [unk] , [unk] , and a society of other [eos] cls2 - sp0 : -130.20 -2.60 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] people gloomy , only example gloomy to be [unk] gloomy . [eos] cls2 - sp1 : -130.41 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] people horsemanship , only example gloomy to be [unk] gloomy . [eos] cls2 - sp2 : -130.45 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] center gloomy , only example gloomy to be [unk] gloomy . [eos] cls2 - sp3 : -130.45 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] people gloomy , you example gloomy to be [unk] gloomy . [eos] cls2 - sp4 : -130.52 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] national gloomy , only example gloomy to be [unk] gloomy . [eos] cls3 - sp0 : -104.92 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of were number of the [unk] people center , only example state to be [unk] the . [eos] cls3 - sp1 : -104.96 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of were crime of the [unk] people center , only example state to be [unk] the . [eos] cls3 - sp2 : -104.97 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of were number of the [unk] people center , only example and to be [unk] the . [eos] cls3 - sp3 : -104.98 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of other number of the [unk] people center , only example state to be [unk] the . [eos] cls3 - sp4 : -105.01 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of other number of the [unk] people center , only example and to be [unk] the . [eos] ID=/home/blu/corpora/brown/tokens/nce/valid-sample.json-399 src: none none 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt0: mod/noi/dif/loss/nce/logp -202.77/-5.14 /-197.62/9.41/-9.41 -4.06 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt1: mod/noi/dif/loss/nce/logp -202.77/-5.14 /-197.62/ /-9.41 -4.06 /-0.10 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you mustn't expect to be [unk] socially . [eos] tgt2: mod/noi/dif/loss/nce/logp -394.31/-13.96 /-380.36/ /-192.14 -15.77/-0.56 26 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt . [eos] tgt3: mod/noi/dif/loss/nce/logp -358.08/-13.32 /-344.76/ /-156.54 -19.89/-0.74 19 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] . [eos] tgt4: mod/noi/dif/loss/nce/logp -397.19/-15.57 /-381.62/ /-193.40 -14.19/-0.56 29 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] . [eos] tgt5: mod/noi/dif/loss/nce/logp -203.98/-15.77 /-188.22/ /-0.00 -4.08 /-0.32 51 [bos] additionally , since you're going to be [unk] de combat pretty soon with [unk] , [unk] , delhi boil , the [unk] wilt , liver [unk] , [unk] , and a host of other complications of the [unk] you've aroused , you dana expect to be [unk] socially . [eos] cls0 - sp0 : -94.36 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , delivering preceding , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you preceding under to be [unk] government . [eos] cls0 - sp1 : -94.36 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , agree agree , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you preceding under to be [unk] government . [eos] cls0 - sp2 : -94.38 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , delivering preceding , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you ) under to be [unk] government . [eos] cls0 - sp3 : -94.43 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , delivering agree , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you preceding under to be [unk] government . [eos] cls0 - sp4 : -94.46 -1.89 51 0.04 [bos] '' , has were were to be [unk] world secretarial rome , with [unk] , [unk] , agree agree , the [unk] preceding , preceding [unk] , [unk] , and a government of other within of the [unk] . is , you ) under to be [unk] government . [eos] cls1 - sp0 : -96.30 -2.75 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , unquestionably [unk] , [unk] , and a course of other [eos] cls1 - sp1 : -96.39 -2.75 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , unquestionably [unk] , [unk] , and a preceding of other [eos] cls1 - sp2 : -96.44 -2.76 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , superiors [unk] , [unk] , and a preceding of other [eos] cls1 - sp3 : -96.61 -2.76 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , unquestionably [unk] , [unk] , and a different of other [eos] cls1 - sp4 : -96.64 -2.76 36 0.29 [bos] '' , most were were to be [unk] few delivering dr. , with [unk] , [unk] , delivering horsemanship , the [unk] preceding , superiors [unk] , [unk] , and a society of other [eos] cls2 - sp0 : -130.20 -2.60 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] people gloomy , only example gloomy to be [unk] gloomy . [eos] cls2 - sp1 : -130.41 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] people horsemanship , only example gloomy to be [unk] gloomy . [eos] cls2 - sp2 : -130.45 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] center gloomy , only example gloomy to be [unk] gloomy . [eos] cls2 - sp3 : -130.45 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] people gloomy , you example gloomy to be [unk] gloomy . [eos] cls2 - sp4 : -130.52 -2.61 51 0.74 [bos] '' , property were were to be [unk] number people streets gloomy with [unk] , [unk] , gloomy the , the [unk] way , crime [unk] , [unk] , and a gloomy of were gloomy of the [unk] national gloomy , only example gloomy to be [unk] gloomy . [eos] cls3 - sp0 : -104.92 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of were number of the [unk] people center , only example state to be [unk] the . [eos] cls3 - sp1 : -104.96 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of were crime of the [unk] people center , only example state to be [unk] the . [eos] cls3 - sp2 : -104.97 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of were number of the [unk] people center , only example and to be [unk] the . [eos] cls3 - sp3 : -104.98 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of other number of the [unk] people center , only example state to be [unk] the . [eos] cls3 - sp4 : -105.01 -2.10 51 1.00 [bos] '' , but personal were to be [unk] number people streets , with [unk] , [unk] , people the , the [unk] example , crime [unk] , [unk] , and a state of other number of the [unk] people center , only example and to be [unk] the . [eos]